-- Logs begin at Fri 2022-06-17 07:38:26 UTC, end at Fri 2022-06-17 09:05:13 UTC. -- Jun 17 08:26:43.921163 dv-cinder-803773-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 08:26:43.929705 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:26:43 2022] *** Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: nodename: dv-cinder-803773-4-iscsi Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: machine: x86_64 Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: clock source: unix Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: pcre jit disabled Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: detected number of CPU cores: 4 Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: current working directory: / Jun 17 08:26:43.931599 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: your processes number limit is 47680 Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: your memory page size is 4096 bytes Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: detected max file descriptor number: 2048 Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: lock engine: pthread robust mutexes Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: thunder lock: enabled Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 08:26:43.932289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:26:43.975893 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: Python main interpreter initialized at 0x55efaad289c0 Jun 17 08:26:43.975893 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: python threads support enabled Jun 17 08:26:43.975893 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: your server socket listen backlog is limited to 100 connections Jun 17 08:26:43.975893 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:26:43.976289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:26:43.976289 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: *** Operational MODE: preforking *** Jun 17 08:26:43.976581 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:26:43.976581 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: spawned uWSGI master process (pid: 103704) Jun 17 08:26:43.976786 dv-cinder-803773-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 08:26:43.982278 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: spawned uWSGI worker 1 (pid: 103705, cores: 1) Jun 17 08:26:43.982278 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: spawned uWSGI worker 2 (pid: 103706, cores: 1) Jun 17 08:26:43.982278 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:26:44.641772 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:26:44.655285 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:26:45.820082 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:26:45.820082 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes Jun 17 08:26:45.820798 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:26:45.820798 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes Jun 17 08:26:45.827462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:26:45.827462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: from cryptography.utils import int_from_bytes Jun 17 08:26:45.827889 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:26:45.827889 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: from cryptography.utils import int_from_bytes Jun 17 08:26:48.449921 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:26:48.450588 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:26:48.450690 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:26:48.451014 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:26:48.451688 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:26:48.452098 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.452423 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.452775 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.453094 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.453416 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.453732 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.454050 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.454367 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.454691 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.454950 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.455262 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.455584 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803773-4-iscsi {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.455901 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.456206 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.456541 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.456859 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.457163 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.457481 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.457782 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.458277 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.458723 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.459025 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.459330 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.459663 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.459971 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.460274 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.460610 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.460917 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.461237 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.461541 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.461933 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803773-4-iscsi {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.462246 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.462553 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.462871 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.463286 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.463574 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.463879 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.464195 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.464541 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.464847 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.465169 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.465483 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.465797 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.466112 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.466417 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.466720 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.467530 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.467858 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.468163 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.468469 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.468752 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.469058 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.469230 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:26:48.469595 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.469677 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:26:48.469764 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.469995 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.470083 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:26:48.470244 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.470358 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:26:48.470491 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.470618 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:26:48.470805 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471006 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471124 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471334 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471424 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471657 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471743 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.471979 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472085 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472299 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472394 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472630 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472743 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.472947 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473087 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473234 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473326 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473535 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473635 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473834 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.473934 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474146 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474242 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474463 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474554 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803773-4-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474767 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.474857 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475076 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475173 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475387 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475473 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475704 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.475793 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476007 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476104 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476327 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476412 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476672 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476770 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.476980 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.477227 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.477379 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.477539 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.477631 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.477844 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478008 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478155 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478247 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478471 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478555 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478789 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.478884 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479098 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479187 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479404 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479488 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479651 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479747 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.479948 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480042 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480247 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480333 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480583 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480728 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803773-4-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.480886 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481046 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481186 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481359 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481487 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481673 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.481783 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.482084 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.482181 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.482881 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.482996 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.483514 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.483766 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.483867 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484081 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484186 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484384 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484469 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484712 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.484811 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485018 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485102 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485324 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485410 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485626 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485723 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.485942 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486027 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486257 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486343 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486559 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486652 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486861 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.486952 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487167 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487262 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487469 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487562 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487747 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.487837 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488056 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488141 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488360 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488453 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488700 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.488788 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489003 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489088 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489265 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489352 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489519 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489617 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489842 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.489928 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490165 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490257 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490476 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490561 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490770 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.490861 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491158 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491377 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491466 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491676 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491768 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.491977 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492061 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492275 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492366 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492600 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492702 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492901 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.492997 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493202 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493335 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493500 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493598 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493798 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.493884 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494096 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494412 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494522 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494742 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.494845 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495024 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495121 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495325 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495418 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495625 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495717 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.495938 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.496024 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.496268 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.496355 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.496620 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.496709 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.496929 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.497012 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.497492 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.497633 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.497800 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.497885 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.498727 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.499078 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.499272 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.499380 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.499502 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.499636 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.499818 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.499944 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.500131 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.500252 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.500459 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.500595 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.500793 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.500895 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.501105 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.501191 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.501417 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.501503 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.501732 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.501827 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.502046 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.502131 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.502366 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.502461 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.502674 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.502774 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.502984 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.503068 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.503292 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.503419 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.503598 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.503684 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.503904 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.504049 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.504215 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.504332 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.504543 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.504683 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.504852 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.504936 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.505174 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.505257 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.505483 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.505571 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.505790 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.505882 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.506097 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.506191 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.506404 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.506490 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.506708 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.506797 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.507014 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.507100 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.507319 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.507404 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.507640 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.507724 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.507946 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.508028 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.508253 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.508339 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.508586 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.508689 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.508893 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.508987 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.509199 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.509282 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.509502 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.509585 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.509806 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.509898 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.510110 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.510196 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.510425 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.510508 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.510731 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.510830 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.511036 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.511129 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.511338 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.511421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.511643 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.511740 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.511946 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.512030 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.512250 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.512335 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.512577 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.512680 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.512875 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.512959 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.513175 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.513284 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.513502 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.513602 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.514391 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.514736 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.514840 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.515006 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.515201 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.515303 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.515565 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.515649 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:26:48.515922 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516006 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516253 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516346 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516629 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516717 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.516950 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517043 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517275 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517367 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517600 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517692 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.517920 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518003 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518233 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518318 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518546 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518637 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518864 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.518949 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519179 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519270 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519494 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519593 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519809 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.519906 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520118 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520202 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520436 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520563 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520770 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.520864 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521082 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521169 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521400 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521488 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521717 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.521811 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522029 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522112 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522342 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522425 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522655 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522787 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.522977 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523068 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523291 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523376 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523603 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523697 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.523943 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524028 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524270 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524354 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524603 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524731 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.524937 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525055 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525265 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525362 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525587 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525674 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525895 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.525981 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526217 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526313 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526514 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526606 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526822 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.526906 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527127 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527219 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527435 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527520 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527743 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.527844 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528050 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528143 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528356 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528443 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528685 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528785 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.528992 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.529101 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.529369 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.529971 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530208 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530293 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530681 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530828 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.530913 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531132 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531216 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531477 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531571 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531785 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.531870 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532116 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532199 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532428 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532544 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532766 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.532850 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533164 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533391 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533485 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533707 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.533801 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534021 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534112 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534329 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534414 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534644 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534754 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.534961 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535056 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535271 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535364 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535581 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535666 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535888 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.535979 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536196 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536281 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536531 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536619 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536844 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.536937 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537150 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537234 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537457 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537540 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537775 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.537879 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538082 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538167 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538406 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538490 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538713 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.538798 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539020 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539104 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539333 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539417 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539644 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539736 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.539953 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540046 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540261 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540353 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540595 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540683 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540905 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.540989 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541224 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541309 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541532 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541623 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541850 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.541935 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542161 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542255 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542476 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542559 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542782 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.542881 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543099 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543191 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543406 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543492 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543719 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.543802 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544032 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544129 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544338 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544423 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544697 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.544794 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545045 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545157 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545370 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545456 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545683 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545767 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.545993 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546086 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546305 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546390 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546611 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546696 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.546916 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547008 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547225 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547312 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547538 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547621 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547846 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.547931 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548152 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548241 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548454 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548590 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548790 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.548878 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549100 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549192 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549404 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549498 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549707 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.549792 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550017 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550102 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550339 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550432 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550647 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550732 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.550969 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551053 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551284 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551376 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551586 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551671 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551888 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.551975 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552199 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552290 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552520 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552619 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552829 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.552914 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553133 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553227 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553437 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553522 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553764 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.553846 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554077 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554165 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554380 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554467 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554686 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.554769 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555004 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555103 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555319 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555633 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555718 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.555943 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556029 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556252 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556337 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556598 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556686 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.556914 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557001 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557223 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557308 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557534 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557626 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557841 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.557925 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558151 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558234 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558458 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558555 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558772 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.558864 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559079 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559163 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559386 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559547 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559696 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559788 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.559999 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.560085 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.560306 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.560399 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.560695 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.560845 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561022 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561270 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561501 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561620 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561742 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.561904 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.562133 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.562219 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.562530 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.562616 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.562847 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.563119 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.563210 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.563492 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.563613 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.563838 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.564101 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.564198 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.564441 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.564632 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.564771 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565075 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565160 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565391 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565614 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565697 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.565987 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.566135 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.566290 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.566597 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.566681 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.566900 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.567061 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.567202 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.567504 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.567594 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.567807 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568008 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568103 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568407 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568515 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568738 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.568995 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.569078 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.569347 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.569471 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.569653 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.569944 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570027 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570245 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570430 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570546 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570887 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.570971 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.571189 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.571396 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.571525 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.571854 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.571938 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.572196 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.572382 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.572516 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.572822 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.572916 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.573145 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.573355 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.573439 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.573738 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.573859 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574041 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574342 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574425 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574649 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574820 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.574955 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.575270 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.575359 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.575578 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.575754 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.575886 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.576739 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577235 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577342 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577424 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577509 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577629 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577769 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.577944 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.578252 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.578344 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.578555 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.578834 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.578917 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.579153 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.579386 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.579478 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.579750 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.579943 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.580057 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.580359 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.580549 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.580701 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581008 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581093 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581312 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581611 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581715 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.581921 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.582213 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.582307 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.582704 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.582806 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.582885 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583035 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583122 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583360 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583446 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583690 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.583776 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584009 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584095 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584311 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584397 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584642 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584730 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.584955 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585042 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585280 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585365 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585589 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585682 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585896 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.585981 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.586207 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.586292 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.586509 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.586792 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.586878 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587104 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587196 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587411 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587503 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587713 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.587999 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588091 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588301 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588386 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588626 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588815 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.588928 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.589250 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.589335 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.589557 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.589754 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.589860 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.590164 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.590312 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.590465 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593042 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593138 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593217 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593303 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593383 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593459 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593542 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593620 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593713 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593793 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593868 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.593943 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594018 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594093 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594177 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594262 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594340 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594412 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594476 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594538 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594620 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594704 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594781 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.594935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.595035 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.596826 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.596954 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597028 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597101 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597166 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597228 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597299 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597364 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597427 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597489 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597557 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597622 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597692 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597757 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597819 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597880 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.597880 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598007 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598090 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598167 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598327 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598671 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.598799 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.599006 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.599257 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.599525 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.599609 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.599886 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.600108 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.600205 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.600521 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.600705 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601036 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601154 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601362 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601538 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601678 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601813 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.601950 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602085 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602285 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602438 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602607 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602749 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.602927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603074 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603243 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603404 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603569 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603704 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.603881 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.604074 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.604194 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.604519 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.604669 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.604836 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.605146 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.605243 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.605465 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.605759 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.605844 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.606075 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.606156 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.606387 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.606585 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.606833 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.607152 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.607235 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.607642 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608080 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608181 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608181 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608339 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608509 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608874 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.608972 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.609197 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.609513 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.609599 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.609836 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.610047 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.610141 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.610563 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.610658 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.610907 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.611081 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.611223 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.611538 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.611624 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.611847 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.612059 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.612144 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.612451 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.612661 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.613007 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.613117 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.613206 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.613403 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614069 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614171 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614251 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614328 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614405 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614480 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614737 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614830 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.614909 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615023 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615190 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615339 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615524 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615653 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.615849 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616070 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616156 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616384 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616478 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616720 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.616806 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617045 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617130 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617472 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617685 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617776 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.617986 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618070 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618291 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618375 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618596 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618680 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.618901 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619033 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619209 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619294 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619526 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619612 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619836 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.619926 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620138 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620233 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620443 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620565 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620775 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.620907 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621092 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621175 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621416 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621499 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621779 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.621875 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.622343 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.622433 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.622662 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.622748 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.622990 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.623582 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624099 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624203 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624283 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624359 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624475 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624595 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624809 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.624930 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625129 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625228 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625444 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625567 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625773 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.625892 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626203 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626392 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626511 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626703 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.626837 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627013 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627150 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627319 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627463 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627623 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627789 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.627946 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628115 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628250 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628443 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628616 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628777 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.628932 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629096 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629256 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629412 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629580 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629696 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.629883 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630009 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630207 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630320 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630516 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630633 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630820 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.630944 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631125 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631256 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631426 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631567 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631767 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.631860 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632158 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632392 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632541 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632746 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.632832 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633079 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633181 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633394 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633479 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633710 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.633792 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634016 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634102 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634327 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634411 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634633 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634717 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.634946 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635051 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635249 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635336 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635556 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635684 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635868 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.635996 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636172 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636309 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636476 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636652 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636798 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.636966 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637106 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637278 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637410 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637594 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637711 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.637911 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.638006 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.638215 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.638322 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.638644 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.638760 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.639487 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.639923 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640008 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640100 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640198 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640278 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640378 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640544 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640704 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.640856 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641047 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641170 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641350 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641685 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.641811 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642006 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642120 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642329 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642421 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642658 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642752 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.642969 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643055 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643294 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643522 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643911 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.643996 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.644225 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.644310 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.644558 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.644657 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.644877 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645012 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645196 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645327 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645507 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645644 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645821 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.645973 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646134 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646301 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646447 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646630 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646764 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.646939 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647255 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647338 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647568 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647699 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647895 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.647987 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648223 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648308 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648560 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648660 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648877 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.648961 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649184 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649270 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649495 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649587 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649808 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.649937 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650120 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650206 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650431 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650518 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650761 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.650847 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651086 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651176 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651412 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651502 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651749 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.651835 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652065 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652159 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652379 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652464 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652710 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.652794 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653023 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653120 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653331 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653414 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653644 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653728 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.653973 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.654066 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.654320 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.654572 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.654977 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655060 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655281 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655371 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655448 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655525 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655525 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655661 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655819 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.655905 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656127 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656210 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656435 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656550 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656769 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.656858 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657082 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657166 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657394 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657487 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657716 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.657800 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658025 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658110 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658349 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658442 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658660 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658744 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.658967 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659050 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659370 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659581 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659792 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.659924 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660109 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660229 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660447 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660582 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660797 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.660885 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661124 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661217 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661442 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661534 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661762 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.661848 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662090 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662183 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662398 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662482 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662702 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.662788 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663013 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663111 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663322 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663407 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663626 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663711 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.663948 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664041 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664258 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664342 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664582 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664670 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664889 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.664975 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.665198 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.665321 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.665505 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.665736 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.665831 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666086 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666172 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666402 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666487 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666708 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.666800 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667033 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667119 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667344 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667428 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667647 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667742 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.667951 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668041 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668254 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668338 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668577 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668665 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668897 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.668994 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669207 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669301 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669511 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669597 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669815 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.669956 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670191 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670302 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670502 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670589 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670809 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.670894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671119 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671204 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671424 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671510 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671738 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.671829 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672043 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672135 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672348 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672434 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672679 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672766 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.672992 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673088 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673295 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673388 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673594 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673679 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673901 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.673995 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.674204 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.674290 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.674513 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.674750 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.674835 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675085 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675172 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675405 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675490 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675720 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.675813 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676024 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676108 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676335 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676418 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676677 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676842 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.676996 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677087 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677307 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677396 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677611 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677704 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.677923 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678007 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678232 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678316 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678555 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678651 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678868 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.678960 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679180 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679313 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679509 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679595 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679828 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.679913 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.680145 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.680360 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.680454 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.680730 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.680816 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681053 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681140 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681391 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681485 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681726 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.681810 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682035 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682118 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682345 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682437 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682652 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682831 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.682963 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683049 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683276 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683363 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683591 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683680 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683899 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.683991 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684209 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684299 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684541 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684640 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684856 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.684953 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.685168 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.685260 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.685500 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.686086 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.686369 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.686762 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.686846 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.686925 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687045 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687130 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687365 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687459 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687676 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687890 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.687976 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688211 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688309 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688574 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688673 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688910 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.688996 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.689240 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.689334 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.689561 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.689646 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.689882 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690008 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690197 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690291 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690509 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690600 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690817 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.690914 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691132 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691217 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691442 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691525 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691750 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.691843 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692059 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692150 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692373 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692479 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692706 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.692819 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693029 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693141 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693341 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693465 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693778 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.693870 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694100 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694213 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694423 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694532 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694735 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.694861 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695061 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695189 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695373 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695512 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695709 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.695805 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696047 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696132 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696377 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696461 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696728 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.696831 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697036 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697121 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697343 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697437 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697649 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697733 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.697957 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698040 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698267 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698351 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698576 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698661 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698879 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.698964 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699183 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699276 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699487 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699572 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699789 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.699872 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700143 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700236 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700400 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700504 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700728 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.700814 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.701038 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.701174 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702215 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702312 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702312 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702448 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702525 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702615 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702819 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.702904 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703133 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703217 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703442 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703540 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703759 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.703855 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704067 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704150 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704375 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704472 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704706 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.704801 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705015 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705100 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705320 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705406 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705661 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705746 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.705968 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706057 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706275 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706361 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706594 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706687 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706907 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.706993 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707228 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707314 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707540 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707633 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707850 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.707934 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.708172 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.708263 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.708505 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.708593 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.708822 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709047 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709142 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709384 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709469 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709708 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.709793 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710047 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710176 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710356 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710450 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710669 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710755 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.710978 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711064 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711287 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711377 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711615 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711711 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.711921 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712007 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712231 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712314 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712577 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712678 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712893 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.712981 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713206 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713300 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713516 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713613 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713827 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.713912 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714139 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714224 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714446 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714532 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714756 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.714843 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715062 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715154 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715370 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715456 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715680 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715765 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.715995 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.716090 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.716324 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.716417 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.716671 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.716775 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717477 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717572 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717653 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717730 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717807 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.717972 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718109 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718285 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718429 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718598 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718777 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.718911 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719108 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719231 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719428 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719563 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719743 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.719883 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.720055 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.720191 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.720318 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:26:48.720635 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.720953 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.721276 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.721602 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.721915 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.722240 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.722564 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.722876 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.723199 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.723519 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.723851 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.724190 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.724542 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.724872 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.725180 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.725487 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.725795 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.726106 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.726511 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.726830 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.727139 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.727445 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.727756 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.728062 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.728368 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.728701 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.729011 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.729322 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.729628 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.729934 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.730240 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.730546 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.730850 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.731153 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.731463 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.731769 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.732430 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.733019 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.733112 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.733427 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.733770 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.734090 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.734417 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.734731 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.735057 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.735370 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.735696 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.736022 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.736338 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.736678 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.737018 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.737335 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.737651 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.737963 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.738277 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.738589 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.738902 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.739232 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.739559 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.739866 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.740193 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.740528 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.740854 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.741172 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.741486 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.741818 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.742128 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.742440 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.742757 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.743067 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.743377 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.743700 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.744018 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.744347 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.744701 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.745015 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.745344 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.745672 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.746023 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.746339 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.746688 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.747019 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.747592 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.747907 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.749085 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:26:48.749085 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:26:48.783100 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Registered counter for database nova_api Jun 17 08:26:48.803548 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.810003 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:48.813134 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Registered counter for database nova_api Jun 17 08:26:48.835180 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.841628 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:48.868780 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.context [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d0bb3b-ac5e-4898-8788-aaf56ff0084f(cell1) {{(pid=103705) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:26:48.873678 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:26:48.875236 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:26:48.876016 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:26:48.878046 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:26:48.879989 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Registered counter for database nova_cell0 Jun 17 08:26:48.883820 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Registered counter for database nova_cell1 Jun 17 08:26:48.891685 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.893582 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.899031 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:48.901350 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.context [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d0bb3b-ac5e-4898-8788-aaf56ff0084f(cell1) {{(pid=103706) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:26:48.901600 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:48.906069 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:26:48.907648 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:26:48.908463 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:26:48.910521 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:26:48.912517 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Registered counter for database nova_cell0 Jun 17 08:26:48.916392 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Registered counter for database nova_cell1 Jun 17 08:26:48.924408 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.926158 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:48.931175 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:49.052159 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Registered counter for database nova_cell0 Jun 17 08:26:49.060071 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:49.064441 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:49.074643 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:49.085285 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Registered counter for database nova_cell0 Jun 17 08:26:49.094615 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:26:49.098888 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:26:49.493314 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:26:49.501500 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:26:49.508359 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:26:49.515589 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:26:49.842920 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:26:49.849023 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:26:49.854147 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efaad289c0 pid: 103705 (default app) Jun 17 08:26:49.856209 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:26:49.857955 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jun 17 08:26:49.858474 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jun 17 08:26:49 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:26:49.858627 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:26:49.864621 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-294bd640-d236-49b3-8b50-ca62f4068ec6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:26:49.869895 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efaad289c0 pid: 103706 (default app) Jun 17 08:28:09.866967 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:09.868264 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jun 17 08:28:09.868843 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:28:09.880738 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:09.881696 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell1:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:09.882677 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:09.883437 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:10.331178 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a1de659f-6fb1-4d97-a4df-8d3a8f1c140d admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:10.363422 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a1de659f-6fb1-4d97-a4df-8d3a8f1c140d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487759 Jun 17 08:28:10.364158 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 08:28:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:12.557449 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:12.559232 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-11ac968a-caf3-49d3-92f5-681e55e4f7af None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Jun 17 08:28:12.565133 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:12.631189 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f10f6788-67bf-4f5f-9def-d08248c4a674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:12.653667 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:28:12.653667 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: warnings.warn(msg) Jun 17 08:28:12.737653 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f10f6788-67bf-4f5f-9def-d08248c4a674 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.170953 Jun 17 08:28:12.738416 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:12.753041 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:12.754420 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell1:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:12.755375 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell0:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:12.756673 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:28:12.963226 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-770fbafe-b093-492f-bbf2-bd9fdd48ca8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:12.965680 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:28:12.965680 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:28:13.119058 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-770fbafe-b093-492f-bbf2-bd9fdd48ca8e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.371608 Jun 17 08:28:13.119653 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 08:28:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:15.318993 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f10f6788-67bf-4f5f-9def-d08248c4a674 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:15.320010 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f10f6788-67bf-4f5f-9def-d08248c4a674 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 17 08:28:15.320976 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:15.449558 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-916463fe-907d-4c1d-a90c-fb18ead1f0f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:15.471120 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:28:15.471120 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:28:15.580570 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-916463fe-907d-4c1d-a90c-fb18ead1f0f5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.253640 Jun 17 08:28:15.581140 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:28:15.593456 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a42b753b-f1bd-418f-bc24-ac852510a5ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:15.594942 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:28:15.594942 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: warnings.warn(msg) Jun 17 08:28:15.675424 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a42b753b-f1bd-418f-bc24-ac852510a5ca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085557 Jun 17 08:28:15.676239 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 08:28:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:17.861571 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-916463fe-907d-4c1d-a90c-fb18ead1f0f5 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:17.862585 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-916463fe-907d-4c1d-a90c-fb18ead1f0f5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 17 08:28:17.862987 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:17.932711 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-4cbd4219-19ce-42f8-aff4-0888284d9bff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:18.021036 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-4cbd4219-19ce-42f8-aff4-0888284d9bff admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151557 Jun 17 08:28:18.021639 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:28:18.035144 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f46662d0-6cd8-4351-be16-7a21ca341d15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:18.143482 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-f46662d0-6cd8-4351-be16-7a21ca341d15 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112190 Jun 17 08:28:18.144130 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 08:28:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:20.363312 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-4cbd4219-19ce-42f8-aff4-0888284d9bff admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:20.364378 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-4cbd4219-19ce-42f8-aff4-0888284d9bff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 17 08:28:20.364836 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:20.427510 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3b08b173-1e41-4cac-ac6c-848015900706 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "id": "d3"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:20.517101 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3b08b173-1e41-4cac-ac6c-848015900706 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145303 Jun 17 08:28:20.517828 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:20.530878 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-bba4b3ab-b223-440a-94f9-58b7f49a410a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:20.613570 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-bba4b3ab-b223-440a-94f9-58b7f49a410a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086363 Jun 17 08:28:20.614167 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 08:28:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:22.854319 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3b08b173-1e41-4cac-ac6c-848015900706 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:22.855251 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3b08b173-1e41-4cac-ac6c-848015900706 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 17 08:28:22.855649 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:22.920729 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:23.004865 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142936 Jun 17 08:28:23.015125 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:23.020400 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f7251a95-c16b-4853-821d-2cadec86fe22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:23.126183 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-f7251a95-c16b-4853-821d-2cadec86fe22 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109277 Jun 17 08:28:23.126679 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 08:28:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:25.341678 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:25.342691 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 17 08:28:25.343092 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:25.405620 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-6f56890a-546b-405c-93ee-70dd0695eaa8 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:25.431050 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-6f56890a-546b-405c-93ee-70dd0695eaa8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081933 Jun 17 08:28:25.431638 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 08:28:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:28:27.836397 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:27.837494 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-b975ae5c-d451-4bfd-859d-63a590cee3e7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jun 17 08:28:27.838523 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:27.902246 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-282ac4f6-c839-4e29-83f6-c2557108c624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:28.019639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-282ac4f6-c839-4e29-83f6-c2557108c624 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.174071 Jun 17 08:28:28.020148 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:28.033329 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-090a026b-613a-4d78-85c2-817168144a53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:28.155906 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-090a026b-613a-4d78-85c2-817168144a53 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126228 Jun 17 08:28:28.156520 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 08:28:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:28:30.480264 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-282ac4f6-c839-4e29-83f6-c2557108c624 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:30.481314 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-282ac4f6-c839-4e29-83f6-c2557108c624 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 17 08:28:30.481714 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:30.544713 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-da7098d3-3bf8-4de6-8fa4-e05f430cfc3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "m1.small", "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:30.619804 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-da7098d3-3bf8-4de6-8fa4-e05f430cfc3f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131019 Jun 17 08:28:30.620923 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:28:30.634431 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-50311aca-9ed1-4209-817b-ecb7c1d37266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:30.755171 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-50311aca-9ed1-4209-817b-ecb7c1d37266 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125578 Jun 17 08:28:30.755784 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 08:28:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:32.949991 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-da7098d3-3bf8-4de6-8fa4-e05f430cfc3f admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:32.951019 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-da7098d3-3bf8-4de6-8fa4-e05f430cfc3f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 17 08:28:32.951426 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:33.010792 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4c744dc4-eba0-440d-b024-beb6fddadd1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:33.098803 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4c744dc4-eba0-440d-b024-beb6fddadd1c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141681 Jun 17 08:28:33.099369 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:28:33.111855 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-fc52a8d5-a678-46bd-9723-0cbf0b7ccafb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:33.204690 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-fc52a8d5-a678-46bd-9723-0cbf0b7ccafb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096579 Jun 17 08:28:33.205193 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 08:28:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:28:35.375844 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4c744dc4-eba0-440d-b024-beb6fddadd1c admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:35.376912 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4c744dc4-eba0-440d-b024-beb6fddadd1c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 17 08:28:35.377319 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:35.447476 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f33159ee-18fe-4c33-8f1a-33e4dc811d0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "disk": 80, "swap": 0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:35.516617 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f33159ee-18fe-4c33-8f1a-33e4dc811d0e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132488 Jun 17 08:28:35.517788 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:35.531501 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-cd76f0be-49ca-4bf6-9245-42b3781f6f46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:35.616949 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-cd76f0be-49ca-4bf6-9245-42b3781f6f46 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089154 Jun 17 08:28:35.620756 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 08:28:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:28:37.833778 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f33159ee-18fe-4c33-8f1a-33e4dc811d0e admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:28:37.835963 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f33159ee-18fe-4c33-8f1a-33e4dc811d0e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002637 Jun 17 08:28:37.836361 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:28:37.900942 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "disk": 160, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:37.989983 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.147594 Jun 17 08:28:37.990921 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 08:28:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:28:38.004072 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f454990e-24c6-4be0-98f7-6bf181acbb65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:28:38.079363 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f454990e-24c6-4be0-98f7-6bf181acbb65 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079553 Jun 17 08:28:38.080109 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 08:28:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:29:03.148015 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:03.149039 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 17 08:29:03.149441 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:03.159883 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:03.208646 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-9a48a688-2cd6-4fef-8a1a-e0d933df3d1e admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:03.226166 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-9a48a688-2cd6-4fef-8a1a-e0d933df3d1e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070850 Jun 17 08:29:03.226699 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 08:29:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:04.193926 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:04.194932 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3440c414-fb42-4419-bbeb-620bdcf3e742 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 17 08:29:04.195360 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:04.385745 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-dd3a7de4-e25d-403d-82ef-b58c49cfd5fe admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:04.391302 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-dd3a7de4-e25d-403d-82ef-b58c49cfd5fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-dd3a7de4-e25d-403d-82ef-b58c49cfd5fe admin admin] Request method failure captured: Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept: application/json Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Connection: keep-alive Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Content-Length: 0 Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Host: 10.222.0.48 Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABirDtQABEATMew-Yjhu4JghSUVxWeOmL2YPtCFZitGbgFzQPZoI8iPFj6bvzxfcvFJB-FqSi7JDj3dSxahNQE6B3eooY4BpbKp-xaccyEsLnytvLnbZAl04XuDRUckPyUk6BGYa-PQ2Yxrez8msU48j4lIh-YEmxXY9AH_Ao6xQAL0BrE Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Role: reader,member,admin Jun 17 08:29:04.394566 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Roles: reader,member,admin Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant: admin Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User: admin Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Name: admin Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: method: > Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: exception: Flavor 42 could not be found. Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: action_args: {'id': '42'} Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:04.396296 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:04.397352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.398462 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-dd3a7de4-e25d-403d-82ef-b58c49cfd5fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:04.399451 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-dd3a7de4-e25d-403d-82ef-b58c49cfd5fe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062255 Jun 17 08:29:04.399451 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 08:29:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:04.406055 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8d66cf6a-ab70-488a-ad17-4093c0052a3c admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:04.409120 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:29:04.428964 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8d66cf6a-ab70-488a-ad17-4093c0052a3c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026343 Jun 17 08:29:04.429454 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:04.439564 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d4f5c991-5d74-401f-b04f-95d3a2561012 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:04.461683 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d4f5c991-5d74-401f-b04f-95d3a2561012 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025986 Jun 17 08:29:04.462239 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:04.471352 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f0f6cc24-9eb7-41ac-abbf-e8b5aa8d64a0 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:04.477696 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-f0f6cc24-9eb7-41ac-abbf-e8b5aa8d64a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f0f6cc24-9eb7-41ac-abbf-e8b5aa8d64a0 admin admin] Request method failure captured: Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept: application/json Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Connection: keep-alive Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Content-Length: 0 Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Host: 10.222.0.48 Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABirDtQABEATMew-Yjhu4JghSUVxWeOmL2YPtCFZitGbgFzQPZoI8iPFj6bvzxfcvFJB-FqSi7JDj3dSxahNQE6B3eooY4BpbKp-xaccyEsLnytvLnbZAl04XuDRUckPyUk6BGYa-PQ2Yxrez8msU48j4lIh-YEmxXY9AH_Ao6xQAL0BrE Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Role: reader,member,admin Jun 17 08:29:04.481034 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Roles: reader,member,admin Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant: admin Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User: admin Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Name: admin Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: method: > Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: exception: Flavor 42 could not be found. Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: action_args: {'id': '42'} Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:04.490639 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:04.491421 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:04.492462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f0f6cc24-9eb7-41ac-abbf-e8b5aa8d64a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:04.493691 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-f0f6cc24-9eb7-41ac-abbf-e8b5aa8d64a0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014572 Jun 17 08:29:04.493691 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 08:29:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:05.356538 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d4f5c991-5d74-401f-b04f-95d3a2561012 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:05.357539 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d4f5c991-5d74-401f-b04f-95d3a2561012 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 17 08:29:05.357933 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:05.547918 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-ffef8e2c-c535-42a6-91a0-1455b0b67a4a admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:05.553450 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-ffef8e2c-c535-42a6-91a0-1455b0b67a4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-ffef8e2c-c535-42a6-91a0-1455b0b67a4a admin admin] Request method failure captured: Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept: application/json Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Connection: keep-alive Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Content-Length: 0 Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Host: 10.222.0.48 Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABirDtRvw-vG5uTKK_TkUFsiaGrYfQNEWYxkf1fbpKZsdh3hZBtv77pPISYB_Mixu_JvoIWvWJrApFjaSwCoeN0RrGoiQRhIve3w2xYgM0Yf9h02iuff-X7HqvECNv5R4mUS-c0YHi3S2FGVRUOJsz3Lwrp_thVrhhZWBxGaFBKfCQ6Tdo Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Role: reader,member,admin Jun 17 08:29:05.554935 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Roles: reader,member,admin Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant: admin Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User: admin Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Name: admin Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: method: > Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: exception: Flavor 84 could not be found. Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: action_args: {'id': '84'} Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:05.556606 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:05.557573 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.558664 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-ffef8e2c-c535-42a6-91a0-1455b0b67a4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:05.559717 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-ffef8e2c-c535-42a6-91a0-1455b0b67a4a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060915 Jun 17 08:29:05.559717 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 08:29:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:05.566336 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-dc66d34d-5749-4286-a67a-ad5a896a6bed admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:05.582067 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-dc66d34d-5749-4286-a67a-ad5a896a6bed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019511 Jun 17 08:29:05.583335 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:05.592662 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-11f0e4a0-7360-4c89-9660-48b7580a0be3 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:05.607265 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-11f0e4a0-7360-4c89-9660-48b7580a0be3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018143 Jun 17 08:29:05.607779 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:05.616871 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-db6f7eac-ce71-4e34-b716-26a8cdd993b7 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:05.622405 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-db6f7eac-ce71-4e34-b716-26a8cdd993b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-db6f7eac-ce71-4e34-b716-26a8cdd993b7 admin admin] Request method failure captured: Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept: application/json Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Connection: keep-alive Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Content-Length: 0 Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Host: 10.222.0.48 Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABirDtRvw-vG5uTKK_TkUFsiaGrYfQNEWYxkf1fbpKZsdh3hZBtv77pPISYB_Mixu_JvoIWvWJrApFjaSwCoeN0RrGoiQRhIve3w2xYgM0Yf9h02iuff-X7HqvECNv5R4mUS-c0YHi3S2FGVRUOJsz3Lwrp_thVrhhZWBxGaFBKfCQ6Tdo Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Role: reader,member,admin Jun 17 08:29:05.623894 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Roles: reader,member,admin Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant: admin Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User: admin Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Name: admin Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: method: > Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: exception: Flavor 84 could not be found. Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: action_args: {'id': '84'} Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:05.625274 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:05.626079 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:05.627220 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-db6f7eac-ce71-4e34-b716-26a8cdd993b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:05.628300 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-db6f7eac-ce71-4e34-b716-26a8cdd993b7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011955 Jun 17 08:29:05.628300 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 08:29:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 17 08:29:06.493872 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-11f0e4a0-7360-4c89-9660-48b7580a0be3 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:06.495129 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-11f0e4a0-7360-4c89-9660-48b7580a0be3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jun 17 08:29:06.495513 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:06.688042 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-55667d70-734c-41e4-a139-74bee004374d admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:06.694437 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-55667d70-734c-41e4-a139-74bee004374d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-55667d70-734c-41e4-a139-74bee004374d admin admin] Request method failure captured: Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept: application/json Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Connection: keep-alive Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Content-Length: 0 Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Host: 10.222.0.48 Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABirDtSBr2CJ80yjsN14cbptnmGVoounMWvpmVNQ57IUZKw2LOUX775968AmdQxq6Gv_Aty_C3SOd9ELGJsTyxVCF0KGj78EcCsHLp9He3hsmCxsYz25Gbhd5PpCoRDWEehYyIFIJh9SIdM3g1u1BSgn5gAxCDjVfElA9uyJ8uYGNHlV7c Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Role: reader,member,admin Jun 17 08:29:06.695927 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Roles: reader,member,admin Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant: admin Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User: admin Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: X-User-Name: admin Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: method: > Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: exception: Flavor 451 could not be found. Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: action_args: {'id': '451'} Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:06.697545 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:06.698413 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.699794 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-55667d70-734c-41e4-a139-74bee004374d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:06.701154 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-55667d70-734c-41e4-a139-74bee004374d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061763 Jun 17 08:29:06.701154 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:29:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:06.707369 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-c30a7d03-ff67-46ad-a8f4-1c44319c7dfe admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:06.721301 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-c30a7d03-ff67-46ad-a8f4-1c44319c7dfe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017867 Jun 17 08:29:06.721830 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:06.731238 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:06.745555 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017808 Jun 17 08:29:06.746083 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 08:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:29:06.756165 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-277a6dc3-1dc7-4de8-9789-97355b853778 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:06.761465 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-277a6dc3-1dc7-4de8-9789-97355b853778 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-277a6dc3-1dc7-4de8-9789-97355b853778 admin admin] Request method failure captured: Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept: application/json Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Connection: keep-alive Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Content-Length: 0 Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Host: 10.222.0.48 Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.90 Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABirDtSBr2CJ80yjsN14cbptnmGVoounMWvpmVNQ57IUZKw2LOUX775968AmdQxq6Gv_Aty_C3SOd9ELGJsTyxVCF0KGj78EcCsHLp9He3hsmCxsYz25Gbhd5PpCoRDWEehYyIFIJh9SIdM3g1u1BSgn5gAxCDjVfElA9uyJ8uYGNHlV7c Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Role: reader,member,admin Jun 17 08:29:06.763072 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Roles: reader,member,admin Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82d4449a875a4811837ecf2ea9ba71ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant: admin Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 82d4449a875a4811837ecf2ea9ba71ec Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User: admin Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Id: cbbc2703cf604866b1601e5d461198e6 Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: X-User-Name: admin Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: method: > Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: exception: Flavor 451 could not be found. Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: action_args: {'id': '451'} Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:29:06.764519 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:06.765371 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Jun 17 08:29:06.766468 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-277a6dc3-1dc7-4de8-9789-97355b853778 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:29:06.767462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-277a6dc3-1dc7-4de8-9789-97355b853778 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012814 Jun 17 08:29:06.767462 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:29:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 08:29:07.641093 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:07.643112 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Jun 17 08:29:07.643513 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:07.836040 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4117d80b-312a-45de-b21d-fbc92874789c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:29:07.983100 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4117d80b-312a-45de-b21d-fbc92874789c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.198989 Jun 17 08:29:07.983656 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 08:29:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:29:08.877154 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:08.878140 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 17 08:29:08.878529 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:09.074866 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-e4747b44-f793-492b-949e-806ee59d7fa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:29:09.223603 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-e4747b44-f793-492b-949e-806ee59d7fa3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.203793 Jun 17 08:29:09.224212 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 08:29:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:29:10.140839 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:10.141843 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 17 08:29:10.142239 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:10.334001 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-df22ad25-2e4a-4699-a562-4c5866daa1d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:29:10.416388 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-df22ad25-2e4a-4699-a562-4c5866daa1d0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.134914 Jun 17 08:29:10.416962 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 08:29:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:29:11.295297 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:11.296294 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 17 08:29:11.296715 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:11.491245 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-7493c36a-e6bf-4e16-9f90-e288713abdac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:29:11.565828 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-7493c36a-e6bf-4e16-9f90-e288713abdac admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.127724 Jun 17 08:29:11.566885 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 08:29:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:29:12.436659 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:12.437660 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 17 08:29:12.438053 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:29:12.636146 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-1db74127-8862-4899-93f0-d92737be22c8 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:29:12.655353 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-1db74127-8862-4899-93f0-d92737be22c8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071249 Jun 17 08:29:12.655826 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jun 17 08:29:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:30:01.228227 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.229295 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-e7f1aa69-2410-4c3d-9ac0-327d81c2d69a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 17 08:30:01.229702 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:30:01.241543 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:30:01.289737 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-5e7c1a67-ac6b-4e71-824e-40f0a68376d4 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.309834 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-5e7c1a67-ac6b-4e71-824e-40f0a68376d4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072990 Jun 17 08:30:01.310355 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:30:01.334109 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ea044e58-970c-4124-b89c-3503b81346f0 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.337556 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=14 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:30:01.342540 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-ea044e58-970c-4124-b89c-3503b81346f0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011988 Jun 17 08:30:01.343055 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:30:01.355053 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4dbb7281-8ec8-493d-9863-e38bda637d6e admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.362741 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4dbb7281-8ec8-493d-9863-e38bda637d6e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011437 Jun 17 08:30:01.363260 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:30:01.375047 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.382783 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011530 Jun 17 08:30:01.383297 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:30:01.395041 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-91e84ce8-ef56-4199-b564-035681cc1a9f admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:30:01.402512 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-91e84ce8-ef56-4199-b564-035681cc1a9f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011720 Jun 17 08:30:01.403020 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 08:30:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:33:32.683158 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:32.684174 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 17 08:33:32.684588 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:33:32.847200 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=6 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.962633 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:32.963795 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:33:32.963795 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:33:32.965042 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:32.965480 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:32.966318 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:32.966772 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:33.006252 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-5086dfbd-1263-46ae-9151-a277e1e8dfde admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160524 Jun 17 08:33:33.006819 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:33:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:33.888765 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:33.889767 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 17 08:33:33.890190 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:33:34.084746 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:34.085966 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:33:34.085966 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:33:34.087131 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:34.087564 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:34.088337 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:34.088803 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:34.109196 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-c0430838-0c9b-486b-a5b0-fc18221dd5f6 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076672 Jun 17 08:33:34.109681 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:33:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:45.421549 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:45.422538 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 17 08:33:45.422928 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:33:45.579426 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell0:SELECT=4 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.580151 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell1:SELECT=4 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.580962 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=8 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.629347 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:45.630550 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:33:45.630550 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:33:45.631785 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:45.632177 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:45.633057 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:45.633784 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:45.659817 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4b22c949-4ecc-4e3d-aba0-ff1f087a4a1f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084913 Jun 17 08:33:45.660368 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:33:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:33:46.547356 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:46.548352 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26266e5d-874c-4f31-927e-2486f8617e44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 17 08:33:46.548785 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 08:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:33:46.756395 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:33:46.757616 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:33:46.757616 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: warnings.warn(msg) Jun 17 08:33:46.758840 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:46.759274 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:46.760048 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:33:46.760473 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:33:46.782441 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-56a01f2b-d840-4a7c-ae16-a4ccd6a45cac admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085244 Jun 17 08:33:46.782997 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 08:33:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:34:44.785892 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: Fri Jun 17 08:34:44 2022 - graceful shutdown triggered... Jun 17 08:34:44.786401 dv-cinder-803773-4-iscsi devstack@n-api.service[103705]: Gracefully killing worker 1 (pid: 103705)... Jun 17 08:34:44.786768 dv-cinder-803773-4-iscsi devstack@n-api.service[103706]: Gracefully killing worker 2 (pid: 103706)... Jun 17 08:34:44.788351 dv-cinder-803773-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 08:34:45.787037 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: worker 1 buried after 1 seconds Jun 17 08:34:45.787592 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: worker 2 buried after 1 seconds Jun 17 08:34:45.787592 dv-cinder-803773-4-iscsi devstack@n-api.service[103704]: goodbye to uWSGI. Jun 17 08:34:45.788655 dv-cinder-803773-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 08:34:45.789213 dv-cinder-803773-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 08:34:45.792032 dv-cinder-803773-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 08:34:45.801912 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:34:45 2022] *** Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: nodename: dv-cinder-803773-4-iscsi Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: machine: x86_64 Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: clock source: unix Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: pcre jit disabled Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: detected number of CPU cores: 4 Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: current working directory: / Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:34:45.803973 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: your processes number limit is 47680 Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: your memory page size is 4096 bytes Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: detected max file descriptor number: 2048 Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: lock engine: pthread robust mutexes Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: thunder lock: enabled Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 08:34:45.804852 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:34:45.851044 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: Python main interpreter initialized at 0x564bff3899c0 Jun 17 08:34:45.851044 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: python threads support enabled Jun 17 08:34:45.851044 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: your server socket listen backlog is limited to 100 connections Jun 17 08:34:45.851044 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:34:45.851462 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:34:45.851532 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: *** Operational MODE: preforking *** Jun 17 08:34:45.851800 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:34:45.853699 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: spawned uWSGI master process (pid: 124524) Jun 17 08:34:45.854046 dv-cinder-803773-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 08:34:45.857645 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: spawned uWSGI worker 1 (pid: 124545, cores: 1) Jun 17 08:34:45.857645 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: spawned uWSGI worker 2 (pid: 124546, cores: 1) Jun 17 08:34:45.857645 dv-cinder-803773-4-iscsi devstack@n-api.service[124524]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:34:46.546427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:34:46.547072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 08:34:47.873905 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:34:47.873905 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: from cryptography.utils import int_from_bytes Jun 17 08:34:47.874633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:34:47.874633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: from cryptography.utils import int_from_bytes Jun 17 08:34:47.915120 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:34:47.915120 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: from cryptography.utils import int_from_bytes Jun 17 08:34:47.915691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:34:47.915691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: from cryptography.utils import int_from_bytes Jun 17 08:34:50.413792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:34:50.414336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:34:50.414591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:34:50.414948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:34:50.415206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:34:50.415600 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.415931 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.416259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.416609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.416948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.417266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.417588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.417911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.418246 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.418512 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.418833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.419162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803773-4-iscsi {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.419490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.419801 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.420114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.420439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.420783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.421111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.421422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.421924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.422374 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.422689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.423007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.423351 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.423467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:34:50.423832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.423919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:34:50.424015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.424189 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:34:50.424296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.424599 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:34:50.424718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.424872 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:34:50.424985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.425242 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.425341 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.425574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.425692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803773-4-iscsi {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.425948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426569 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426650 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.426915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.427015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.427239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.427356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.427730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.427825 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.428062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.428207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.431965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436737 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803773-4-iscsi {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436899 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.436978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.437935 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438113 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438498 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438603 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438603 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.438936 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439094 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439396 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439537 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439614 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439754 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439822 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803773-4-iscsi {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.439983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440138 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440564 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440788 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.440948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441250 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441337 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441479 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441632 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.441882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.442585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.442855 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443131 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443592 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.443952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444630 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444823 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.444999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445178 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445607 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.445966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446493 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446582 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446779 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.446982 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.447933 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448697 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.448982 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.449941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450569 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.450902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451206 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.451837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452048 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.452968 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.453915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454047 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454223 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.454809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.455885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.456869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457001 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457130 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.457945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.458131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.458277 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.458458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.459114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.459318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.459598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.459745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.459884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.460015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.460151 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.460294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.460414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.460575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.460715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.460846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.461049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.461183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.461372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.461505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.461693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.461835 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.462026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.462166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.462341 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.462473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.462652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.462792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.462966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.463099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.463288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.463428 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.463593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.463736 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.463904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.464045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.464230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.464364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.464549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.464695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.464868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.465011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.465177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.465321 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.465485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.465628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.465795 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.465961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.466106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.466236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.466398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.466543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.466708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.466850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.467013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.467146 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.467334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.467476 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.467658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.467799 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.467972 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.468106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.468284 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.468424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.468621 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.468772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.468952 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:34:50.469090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.469301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.469442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.469639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.469767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.469960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470068 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.470941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.471979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.472959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.473991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.474160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.474867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475360 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475491 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.475929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.476928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477619 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.477896 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478647 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.478965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479140 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479452 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479592 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479771 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.479906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480592 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.480922 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481504 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481687 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.481999 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482134 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482788 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.482932 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483407 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.483864 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484193 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484687 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484854 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.484989 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485314 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485489 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.485934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.486115 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.486256 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.486432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.486579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.486994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487306 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487765 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.487930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488377 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.488885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.489836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490246 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490420 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.490900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491371 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.491881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.492007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.492297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.492425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.492630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.492749 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.493683 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.493857 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.493997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494269 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494405 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.494953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495090 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495348 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495483 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.495896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496858 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.496989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497124 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497534 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497670 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.497940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498346 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498867 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.498999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499133 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499576 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.499878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500367 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.500877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501636 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.501944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.502996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503500 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.503953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.504940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.505121 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.505255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.505685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.505881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506282 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506630 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506766 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.506896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.507979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.508972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509113 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509420 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.509930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510576 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.510982 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511478 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.511980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512361 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512514 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.512931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513405 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513555 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.513857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514747 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.514901 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515042 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.515896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516044 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516688 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.516870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.517961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.518668 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.518816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.518816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519675 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.519931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520206 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.520888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.521020 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.521679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.521891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.522915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523169 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.523935 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524353 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524794 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.524923 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.525878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526007 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526274 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526546 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526676 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.526938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.527919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528223 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528702 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.528909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529382 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.529874 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530351 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.530981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531121 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531251 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531555 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.531868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532178 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532477 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.532833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533151 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.533927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534382 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534655 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.534940 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535516 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.535973 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.536147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.536279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.536458 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.536793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.537490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.537708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.537944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538263 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538401 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538812 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.538944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539480 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.539878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540008 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540382 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540532 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.540865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541008 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541277 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.541907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542081 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542214 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.542874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.543873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.544983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545127 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.545941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546493 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.546958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547148 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547291 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547460 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.547919 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548214 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548601 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.548909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549184 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.549871 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.550884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551031 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551555 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.551864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.552025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.552164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.552381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.552652 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.552858 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.553924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.554862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.555787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556312 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.556868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557657 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.557971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.558933 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559391 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.559870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560321 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.560814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561597 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.561852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562484 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.562961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563271 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563577 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.563904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564355 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.564882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565516 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.565966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566156 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566478 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566792 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.566933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.567894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568284 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568455 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568826 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.568955 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.569120 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.569361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.569503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.569683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.569823 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570320 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570635 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.570947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571575 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571713 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.571874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572647 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.572973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573458 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.573993 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574136 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574401 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574682 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.574880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575207 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575855 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.575995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.576991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577169 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.577982 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578612 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.578927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579059 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.579891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580810 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.580995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581141 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581612 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581751 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.581908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.582988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.583177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.583319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.583487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.584237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.584448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.584626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.584773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.584908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585388 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.585840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586477 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.586977 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587157 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.587938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588134 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588269 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588799 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.588937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589573 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.589904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.590875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.591833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592471 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592702 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.592834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593006 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593799 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.593971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594737 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.594913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595223 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.595882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596153 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596289 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596621 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596764 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.596895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.597832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.598936 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.599069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.599837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.599990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.600174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.600309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.600508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.600657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.600942 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601397 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.601891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602666 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.602991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.603966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.604143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.604275 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.604468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.604665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.604860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.605898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606036 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.606957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607614 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.607900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.608087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.608200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.608537 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.608858 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.609175 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.609493 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.609830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.610162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.610492 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.610849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.612632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.612632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.612846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.612943 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.612943 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613778 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.613934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.614122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.614286 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.614434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.614854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.614854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.615508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.615742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.615742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616031 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616175 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616328 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.616881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.617039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.617214 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.617541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.617719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.618060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.618414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.618770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.619105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.619348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.619505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.619709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.619861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.620093 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.620311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.620472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.620778 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.620972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.621122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.621450 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.621628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.621789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622241 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.622989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.623141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.623330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.623638 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.623979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.624145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.624300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.624609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.624797 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625609 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.625950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.626254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.626354 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.626585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.626776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.626906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.627299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.627401 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.627686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.627834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628727 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.628873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629532 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.629860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.630074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.630230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.630390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.630660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.630888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631050 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631198 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.631999 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.632171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.632324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.632599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.632753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.632906 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633058 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.633960 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634568 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.634875 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635040 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.635866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636680 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636835 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.636980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637285 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637437 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637582 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.637885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638048 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638219 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638371 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.638883 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639090 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639718 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.639879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640478 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.640968 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641112 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.641992 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.642153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.642305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.642499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.642662 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.642862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.643860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.644984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645526 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645676 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645829 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.645981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.646640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.646881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.647917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648206 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648679 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.648994 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.649146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.649291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.649435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.649599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.649849 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650607 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.650897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651058 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.651942 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652089 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652232 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652394 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652571 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652735 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.652892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653044 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653495 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.653934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654093 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.654853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655702 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.655852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656006 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656152 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656450 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656695 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.656841 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657009 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.657915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.658980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659283 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.659974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.660979 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.661124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.661277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.661437 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.661590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.662325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.662570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.662840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.663857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664799 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.664960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.665982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666136 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666593 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666738 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.666897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667188 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.667801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.668873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669019 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669769 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.669923 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.670950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671264 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671420 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671572 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.671861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672314 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.672958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.673158 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.673404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.673596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.673751 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.673910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674655 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.674981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675457 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.675986 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.676146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.676293 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.676445 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.676728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.676887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.677041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.677257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.677517 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.677745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.677925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678527 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678527 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.678964 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679261 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.679998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.680954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681152 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.681844 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682346 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682701 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.682854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683662 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683822 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.683973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684445 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.684975 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685132 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685772 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.685929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.686147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:34:50.686302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.686302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.686612 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.686930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.687249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.687588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.687923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.688257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.688607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.688941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.689267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.689593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.689917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.690236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.690573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.690891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.691210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.691534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.691928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.692172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.692524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.692846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.693315 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.693765 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.694097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.694434 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.694772 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.695129 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.695573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.696018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.696362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.696715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.697122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.697447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:34:50.697698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:34:50.750426 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO dbcounter [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Registered counter for database nova_api Jun 17 08:34:50.763434 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO dbcounter [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Registered counter for database nova_api Jun 17 08:34:50.770916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_db.sqlalchemy.engines [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.778358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writer thread running {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:50.783785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.790969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writer thread running {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:50.836837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.context [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d0bb3b-ac5e-4898-8788-aaf56ff0084f(cell1) {{(pid=124545) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:34:50.841124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:34:50.842627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:34:50.843459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:34:50.845475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:34:50.847504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO dbcounter [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Registered counter for database nova_cell0 Jun 17 08:34:50.850024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.context [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d0bb3b-ac5e-4898-8788-aaf56ff0084f(cell1) {{(pid=124546) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 08:34:50.851513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO dbcounter [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Registered counter for database nova_cell1 Jun 17 08:34:50.854310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:34:50.856171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:34:50.857067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:34:50.859151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:34:50.860302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_db.sqlalchemy.engines [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.861316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO dbcounter [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Registered counter for database nova_cell0 Jun 17 08:34:50.861575 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_db.sqlalchemy.engines [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.865594 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO dbcounter [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Registered counter for database nova_cell1 Jun 17 08:34:50.868758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writer thread running {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:50.870179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writer thread running {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:50.873109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.874802 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:50.881538 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writer thread running {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:51.037299 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writer thread running {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:51.043505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO dbcounter [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Registered counter for database nova_cell0 Jun 17 08:34:51.048827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO dbcounter [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Registered counter for database nova_cell0 Jun 17 08:34:51.050716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_db.sqlalchemy.engines [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:51.055971 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_db.sqlalchemy.engines [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:34:51.056522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writer thread running {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:51.060590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writer thread running {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:34:51.395525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: WARNING keystonemiddleware.auth_token [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:34:51.395791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: WARNING keystonemiddleware.auth_token [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:34:51.402868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: WARNING keystonemiddleware.auth_token [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:34:51.403110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: WARNING keystonemiddleware.auth_token [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:34:51.751699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: WARNING keystonemiddleware.auth_token [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:34:51.757967 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: WARNING keystonemiddleware.auth_token [None req-c72c60cb-4c98-41f1-a2f9-65f73788c3f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:34:51.763249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bff3899c0 pid: 124546 (default app) Jun 17 08:34:51.768572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: WARNING keystonemiddleware.auth_token [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 08:34:51.775147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: WARNING keystonemiddleware.auth_token [None req-b3759930-1a5c-41fd-aa3a-2f7014dbf855 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 08:34:51.780348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bff3899c0 pid: 124545 (default app) Jun 17 08:35:33.056902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.058051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.058859 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.059771 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.759533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.761041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.762013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:33.762729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:34.487555 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a6eebef9-f2bc-4c83-9b1b-31b84ca0b40b tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Action: 'create', calling method: .version_select at 0x7ff0271c7820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-110136892"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:34.797453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3a3a07ad-3606-4f4c-b7f3-354c39f0a09f tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Action: 'create', calling method: .version_select at 0x7ff0271c6820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-204884444", "metadata": {"Type": "work"}}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3a3a07ad-3606-4f4c-b7f3-354c39f0a09f tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 121 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:34.832290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-204884444", "metadata": {"Type": "work"}}} Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:34.834013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-204884444', 'metadata': {'Type': 'work'}}}} Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:34.835009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:35:34.836928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:35:34.838295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 08:35:34.838295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.838700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3a3a07ad-3606-4f4c-b7f3-354c39f0a09f tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:34.840395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3a3a07ad-3606-4f4c-b7f3-354c39f0a09f tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.085919 Jun 17 08:35:34.841186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 08:35:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1088 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 08:35:34.852479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8c99cbf2-d743-4ca3-8cfa-22049ebccf54 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Action: 'create', calling method: .version_select at 0x7ff027137af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691473514", "metadata": {"Type": "work"}}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8c99cbf2-d743-4ca3-8cfa-22049ebccf54 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 120 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:34.856027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1691473514", "metadata": {"Type": "work"}}} Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:34.857403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691473514', 'metadata': {'Type': 'work'}}}} Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi '0' Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:34.858292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:35:34.860264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:35:34.862725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 08:35:34.862725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.863690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8c99cbf2-d743-4ca3-8cfa-22049ebccf54 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:34.864853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8c99cbf2-d743-4ca3-8cfa-22049ebccf54 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018213 Jun 17 08:35:34.865980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 08:35:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 08:35:34.878015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-094e6dca-9f6e-4896-a6e0-e1f4c7c01ea5 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Action: 'create', calling method: .version_select at 0x7ff0271c6b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1412565588", "metadata": {"Type": "work"}}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-094e6dca-9f6e-4896-a6e0-e1f4c7c01ea5 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 119 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:34.880826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1412565588", "metadata": {"Type": "work"}}} Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:34.882693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1412565588', 'metadata': {'Type': 'work'}}}} Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise error Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi '' Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:34.883520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 08:35:34.885077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 08:35:34.886129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 08:35:34.886129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:34.887544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-094e6dca-9f6e-4896-a6e0-e1f4c7c01ea5 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:34.888703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-094e6dca-9f6e-4896-a6e0-e1f4c7c01ea5 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017742 Jun 17 08:35:34.889463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 08:35:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:35:34.942477 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7db76de1-9db6-43d4-96fe-73fcfd69cf86 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Calling method '.version_select at 0x7ff0270f4820>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:35.628932 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-7db76de1-9db6-43d4-96fe-73fcfd69cf86 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] HTTP exception thrown: Volume tempest-invalid-1668918848 could not be found. Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7db76de1-9db6-43d4-96fe-73fcfd69cf86 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1668918848 HTTP/1.1 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:35.632983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume tempest-invalid-1668918848 could not be found. Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'tempest-invalid-1668918848'} Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:35.634299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1668918848 could not be found. (HTTP 404) (Request-ID: req-40fa5d94-4921-4a08-b830-57be12b54916) Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.635526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:35.637312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1668918848 could not be found. Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:35.641501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1668918848 could not be found. Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1668918848 could not be found. Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7db76de1-9db6-43d4-96fe-73fcfd69cf86 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 404 to user: Volume tempest-invalid-1668918848 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7db76de1-9db6-43d4-96fe-73fcfd69cf86 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1668918848" status: 404 len: 99 microversion: 2.1 time: 0.709026 Jun 17 08:35:35.644248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 08:35:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1668918848 => generated 99 bytes in 712 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 17 08:35:35.647797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-09dd7ed3-5328-42d5-aaac-991c510ace41 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005579 Jun 17 08:35:35.650138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 08:35:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 08:35:35.677672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3c297833-36a5-4c16-8788-79d1aa87cfa3 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019799 Jun 17 08:35:35.680349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jun 17 08:35:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 08:35:35.703137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75c91d68-1a3a-4cd2-812e-3b4983e11af8 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Calling method '.version_select at 0x7ff027021af0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:36.177254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-75c91d68-1a3a-4cd2-812e-3b4983e11af8 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] HTTP exception thrown: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75c91d68-1a3a-4cd2-812e-3b4983e11af8 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/os-volumes/2c32b7d7-5a75-41d6-859b-74d649398bde HTTP/1.1 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:36.180918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '2c32b7d7-5a75-41d6-859b-74d649398bde'} Jun 17 08:35:36.182456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. (HTTP 404) (Request-ID: req-ad843235-e47a-4a74-8d11-36c428e6245d) Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.183345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:36.184407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:35:36.185494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75c91d68-1a3a-4cd2-812e-3b4983e11af8 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 404 to user: Volume 2c32b7d7-5a75-41d6-859b-74d649398bde could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75c91d68-1a3a-4cd2-812e-3b4983e11af8 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2c32b7d7-5a75-41d6-859b-74d649398bde" status: 404 len: 109 microversion: 2.1 time: 0.494421 Jun 17 08:35:36.186877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:35:35 2022] DELETE /compute/v2.1/os-volumes/2c32b7d7-5a75-41d6-859b-74d649398bde => generated 109 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:36.196288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cca6df83-53f5-4123-9a31-e39b66139ea9 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Calling method '.version_select at 0x7ff027021670>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:36.505243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-cca6df83-53f5-4123-9a31-e39b66139ea9 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] HTTP exception thrown: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cca6df83-53f5-4123-9a31-e39b66139ea9 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Request method failure captured: Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/os-volumes/9965c3d1-7a12-4d31-bafa-e6615532dd4d HTTP/1.1 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzVjgkSm9r-nMQms--EBfRevBTnPzS7nhuxKi5F0sGq-xFEyNQOYbVI2fWDiA9Ka03MwOH3sh0g1nwmiVQ4Soz8YATNOpLkFQad0Ihl9txPBg-bd3WmZdw1zbj7Fi6mGXKI5D7qG4GA_b6fjcTdvBvg2vvFP3Bfkj0sOwl2WKoC7AI Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:36.513337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/493f7f45114e4c95bfebaaf7295ba472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 493f7f45114e4c95bfebaaf7295ba472 Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-8936967 Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 8d137ca8a35c463c8838dc92bfa300dc Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-8936967-project Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '9965c3d1-7a12-4d31-bafa-e6615532dd4d'} Jun 17 08:35:36.514756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. (HTTP 404) (Request-ID: req-3acfdf70-16be-4fa7-a259-089fb88bf8fe) Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.515599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:36.516831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:35:36.518036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cca6df83-53f5-4123-9a31-e39b66139ea9 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] Returning 404 to user: Volume 9965c3d1-7a12-4d31-bafa-e6615532dd4d could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cca6df83-53f5-4123-9a31-e39b66139ea9 tempest-VolumesNegativeTest-8936967 tempest-VolumesNegativeTest-8936967-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9965c3d1-7a12-4d31-bafa-e6615532dd4d" status: 404 len: 109 microversion: 2.1 time: 0.326477 Jun 17 08:35:36.519253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:36 2022] GET /compute/v2.1/os-volumes/9965c3d1-7a12-4d31-bafa-e6615532dd4d => generated 109 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:36.629468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a6eebef9-f2bc-4c83-9b1b-31b84ca0b40b tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.583536 Jun 17 08:35:36.636849 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jun 17 08:35:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 08:35:36.642390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2c355546-5eb6-4339-83c1-01bdbd4accba tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0270219d0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:36.994785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2c355546-5eb6-4339-83c1-01bdbd4accba tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 200 len: 344 microversion: 2.1 time: 0.165528 Jun 17 08:35:36.994785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:36 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:37.645833 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-37a145a7-3fbd-46a8-a2ea-cb5756db1e09 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff02708c670>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:37.821710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d91c1b16-eb4b-43c3-958a-7a22906fd59b tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff027033280>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:37.839022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-37a145a7-3fbd-46a8-a2ea-cb5756db1e09 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d1a68f90-47d2-4783-9b13-d9280201c2a4" status: 200 len: 350 microversion: 2.1 time: 0.203363 Jun 17 08:35:37.840204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:37 2022] GET /compute/v2.1/os-volumes/d1a68f90-47d2-4783-9b13-d9280201c2a4 => generated 350 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:37.946621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d91c1b16-eb4b-43c3-958a-7a22906fd59b tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 200 len: 345 microversion: 2.1 time: 0.128162 Jun 17 08:35:37.948744 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:37 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:37.965449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ab8beff1-afff-47a4-9eb4-e8c45e00a7b7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Action: 'create', calling method: .version_select at 0x7ff02708cca0>, body: {"snapshot": {"volume_id": "d260735b-4d16-46ae-879b-e44ae371501c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1309265998"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:39.031259 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ab8beff1-afff-47a4-9eb4-e8c45e00a7b7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.074603 Jun 17 08:35:39.036265 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 3/13] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jun 17 08:35:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:39.046457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-50061618-bb1b-44f2-a2f6-ed1fa380249c tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff027033c10>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:39.283728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-50061618-bb1b-44f2-a2f6-ed1fa380249c tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.242892 Jun 17 08:35:39.284664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:39 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:39.294339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2130a690-10f8-4d65-8f7c-9e118ca508c0 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0270a2310>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:39.371838 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2130a690-10f8-4d65-8f7c-9e118ca508c0 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.081408 Jun 17 08:35:39.372398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 08:35:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:39.383373 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8bc2dea1-f8d1-46c3-b234-c9cb849bbce1 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff026fc13a0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:39.453298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8bc2dea1-f8d1-46c3-b234-c9cb849bbce1 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.073239 Jun 17 08:35:39.454132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:39 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:40.464807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c7ba9441-82c2-47d0-8e07-6b940070729e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0270b1040>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:40.526788 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c7ba9441-82c2-47d0-8e07-6b940070729e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.065815 Jun 17 08:35:40.527686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:40 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:41.544938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b2cd7e85-b411-45ad-9ca9-24c28bfc98d2 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff027033a60>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:41.678258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b2cd7e85-b411-45ad-9ca9-24c28bfc98d2 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.143084 Jun 17 08:35:41.680808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:41 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:42.692876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1e2d8046-1d52-49b4-b61f-d298ff04042f tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0270a2b80>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:42.793439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1e2d8046-1d52-49b4-b61f-d298ff04042f tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.105996 Jun 17 08:35:42.798015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:42 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:43.806897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b66ad6f4-eb43-489d-a446-f32c786a6257 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff027033550>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:43.894257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b66ad6f4-eb43-489d-a446-f32c786a6257 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.091537 Jun 17 08:35:43.910456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:43 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:44.922786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0d1fab11-53ec-4806-92d4-a75465b05dde tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0270a24c0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:45.005435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0d1fab11-53ec-4806-92d4-a75465b05dde tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.087490 Jun 17 08:35:45.008449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 7/21] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:44 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:45.821981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-413931811", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "networks": [{"uuid": "77aab1a5-78d9-463d-9bf9-54fbe351f3f3"}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:46.020168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-269e82ef-697f-42f9-a42d-0d6380a35809 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff02708cee0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:46.099469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] validate_networks() for [('77aab1a5-78d9-463d-9bf9-54fbe351f3f3', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:35:46.121281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-269e82ef-697f-42f9-a42d-0d6380a35809 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 288 microversion: 2.1 time: 0.106068 Jun 17 08:35:46.123032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 8/22] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:46 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:46.138922 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-102e187d-1515-4d50-8e03-708ed4c958ad tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff02708c820>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:46.372254 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-102e187d-1515-4d50-8e03-708ed4c958ad tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 202 len: 0 microversion: 2.1 time: 0.237601 Jun 17 08:35:46.376423 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 9/23] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 17 08:35:46 2022] DELETE /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:35:46.388050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-812b5876-5d70-4886-8a94-bde7820245b5 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff02708c700>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:46.512389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-812b5876-5d70-4886-8a94-bde7820245b5 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 200 len: 287 microversion: 2.1 time: 0.129805 Jun 17 08:35:46.513454 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 10/24] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:46 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:47.294143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b5f2a192-da56-4f42-bbbb-110899640f13 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff0271ed430>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:47.611375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b5f2a192-da56-4f42-bbbb-110899640f13 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fd9ebfc3-8964-4aaf-a7f8-a41fb4c634b5" status: 200 len: 350 microversion: 2.1 time: 0.320163 Jun 17 08:35:47.612171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 11/25] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:47 2022] GET /compute/v2.1/os-volumes/fd9ebfc3-8964-4aaf-a7f8-a41fb4c634b5 => generated 350 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:35:47.777387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:35:47.777902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:35:47.778281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:35:47.778691 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:35:47.779118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:35:47.815541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:47.816000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:47.816847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:47.817286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:47.885147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-62a303e7-dfde-4051-afc5-b711ae3207b3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: .version_select at 0x7ff0270a2310>, body: {"keypair": {"name": "tempest-keypair-239148950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBU9XOPvJeKQEZ+Cs4ULSRyUJrxDfjvmnLJC3owTeUH87j/3wxrvLxyJuEU8NYdNEMPhKRFXsdUzE+xk99HyiqgZSF+6oHp1I3FR5K0P9fwI0nJwLqIQ6lz7BgnLTHMuw=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:47.938014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Getting quotas for project c8166c0f90124dac9d758720686535e9. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:35:47.954300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Getting quotas for user a9cef287aa974448b3abef26a8018f03 and project c8166c0f90124dac9d758720686535e9. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:35:47.992958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:35:47.998246 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:35:48.027810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-62a303e7-dfde-4051-afc5-b711ae3207b3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:35:48.045140 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-62a303e7-dfde-4051-afc5-b711ae3207b3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for user af32d2a5a83546699f5e2caa3def410d and project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:35:48.270839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-94b95bf3-fc91-42c4-986f-3fedb226e0a7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841338 Jun 17 08:35:48.272294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 15/26] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:35:48.279828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-74e08606-75c7-44de-a4ba-1863c26874a7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff026f26790>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:48.315625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-62a303e7-dfde-4051-afc5-b711ae3207b3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.700726 Jun 17 08:35:48.315625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 12/27] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:35:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:48.325044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1f1dbc94-eee9-44ae-93b7-4d083938751d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:48.342879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1f1dbc94-eee9-44ae-93b7-4d083938751d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:48.517549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1f1dbc94-eee9-44ae-93b7-4d083938751d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:48.541489 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1f1dbc94-eee9-44ae-93b7-4d083938751d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1214 microversion: 2.1 time: 0.224531 Jun 17 08:35:48.542456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 13/28] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:48 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:48.601842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-74e08606-75c7-44de-a4ba-1863c26874a7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] HTTP exception thrown: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-74e08606-75c7-44de-a4ba-1863c26874a7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Request method failure captured: Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f HTTP/1.1 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzUF1rS5J70LPmUEYVW2yaLYepa8KwNS4YoSMGIWx6LtcmVcOSL2GP2LeAgWWa70CBbrkb02Xfna1NvDvVZH8Bgyrjr3XucSOoGv9IikFo1nzDxG_d8r0Z6aqr_LJVoAJv9EaSdtdH4hgWtyL3tJEhp59T9YsI_jxfam7aTY2Pe1mk Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:48.606134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fe87a25072b04f9890e1aab97d6a40ef Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '465ba8f1-2438-467c-bed6-e5f7dd79097f'} Jun 17 08:35:48.607432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. (HTTP 404) (Request-ID: req-1689d7ae-838f-412d-973f-c861be25be8b) Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.608228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:48.609511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 08:35:48.610758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-74e08606-75c7-44de-a4ba-1863c26874a7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Returning 404 to user: Snapshot 465ba8f1-2438-467c-bed6-e5f7dd79097f could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:48.615658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-74e08606-75c7-44de-a4ba-1863c26874a7 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f" status: 404 len: 111 microversion: 2.1 time: 0.334058 Jun 17 08:35:48.616692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 16/29] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 08:35:48 2022] GET /compute/v2.1/os-snapshots/465ba8f1-2438-467c-bed6-e5f7dd79097f => generated 111 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:48.618994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fac1f2cb-86e1-4a4c-b846-68660a80a8db tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0267f2160>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:48.815703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1566957540", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:48.943224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fac1f2cb-86e1-4a4c-b846-68660a80a8db tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 202 len: 0 microversion: 2.1 time: 0.329103 Jun 17 08:35:48.943714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:35:48 2022] DELETE /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:35:48.954022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-58825041-fd74-4f1e-8743-f5801be9930d tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff0267814c0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:48.959119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] validate_networks() for [('c930e804-5e32-4961-9c29-6ba52f705297', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:35:49.241835 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-58825041-fd74-4f1e-8743-f5801be9930d tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 200 len: 344 microversion: 2.1 time: 0.291069 Jun 17 08:35:49.247059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:48 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 344 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:49.572841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1acfb675-1f03-4fe8-b85a-028c4ce46984 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:49.574040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1acfb675-1f03-4fe8-b85a-028c4ce46984 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:49.749349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1acfb675-1f03-4fe8-b85a-028c4ce46984 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:49.759211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1acfb675-1f03-4fe8-b85a-028c4ce46984 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1214 microversion: 2.1 time: 0.201855 Jun 17 08:35:49.759793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:49 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:49.793585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:35:49.794015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:35:49.794492 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:35:49.794982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:35:49.795350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:35:49.813239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:49.813861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:49.815279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:49.815451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:49.836570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:35:49.840768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for user fb1df28c175c40b7a06d1f94ba780d28 and project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:35:49.852711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:35:49.855347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:35:50.009415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8c0819e9-4909-465c-9b03-ba0faac47208 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.278818 Jun 17 08:35:50.026432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 17/33] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:35:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 08:35:50.028388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f6454f6e-a01d-43db-ba28-6dcf8269a682 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:50.035736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f6454f6e-a01d-43db-ba28-6dcf8269a682 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:50.121644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f6454f6e-a01d-43db-ba28-6dcf8269a682 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:50.130420 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f6454f6e-a01d-43db-ba28-6dcf8269a682 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1222 microversion: 2.1 time: 0.105852 Jun 17 08:35:50.131072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:50 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:50.256989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6981bdf5-f279-4bf4-b2ee-c5713493c991 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff026f26f70>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:50.343531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6981bdf5-f279-4bf4-b2ee-c5713493c991 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 200 len: 344 microversion: 2.1 time: 0.092304 Jun 17 08:35:50.344741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:50 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:50.373714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1377364680", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:50.578965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] validate_networks() for [('c930e804-5e32-4961-9c29-6ba52f705297', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:35:50.784415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75768487-2e7c-42b7-a218-88f317ea7b21 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:50.786633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-75768487-2e7c-42b7-a218-88f317ea7b21 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:51.053933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-75768487-2e7c-42b7-a218-88f317ea7b21 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:51.096962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75768487-2e7c-42b7-a218-88f317ea7b21 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1214 microversion: 2.1 time: 0.318695 Jun 17 08:35:51.100179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 19/36] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:50 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:51.356521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-584f0377-02f2-4a6d-99be-b865fd4e96a5 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff025ec21f0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:51.462431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-584f0377-02f2-4a6d-99be-b865fd4e96a5 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 200 len: 344 microversion: 2.1 time: 0.104400 Jun 17 08:35:51.462431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 20/37] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:51 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:35:52.117531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:52.119568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:52.133459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:52.134400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:52.146059 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:52.149944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:52.628121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:52.669426 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c1ae59dc-6f2a-491b-ac00-752ee36c86d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1210 microversion: 2.1 time: 0.556226 Jun 17 08:35:52.677914 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:35:52.678405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:35:52.678902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:35:52.679482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:35:52.681254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:52 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1210 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:52.681671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:35:52.692666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-072c0c36-40d7-4038-b077-bdf6be09602e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff025e52790>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:52.713638 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:52.714067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:52.714922 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:52.715300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:52.751786 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-072c0c36-40d7-4038-b077-bdf6be09602e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] HTTP exception thrown: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-072c0c36-40d7-4038-b077-bdf6be09602e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Request method failure captured: Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c HTTP/1.1 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzUF1rS5J70LPmUEYVW2yaLYepa8KwNS4YoSMGIWx6LtcmVcOSL2GP2LeAgWWa70CBbrkb02Xfna1NvDvVZH8Bgyrjr3XucSOoGv9IikFo1nzDxG_d8r0Z6aqr_LJVoAJv9EaSdtdH4hgWtyL3tJEhp59T9YsI_jxfam7aTY2Pe1mk Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:52.755457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fe87a25072b04f9890e1aab97d6a40ef Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'd260735b-4d16-46ae-879b-e44ae371501c'} Jun 17 08:35:52.757198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. (HTTP 404) (Request-ID: req-057c60da-9f93-41de-869f-d17af28f3265) Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:52.758560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:52.759559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:35:52.762417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-072c0c36-40d7-4038-b077-bdf6be09602e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Returning 404 to user: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-072c0c36-40d7-4038-b077-bdf6be09602e tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 404 len: 109 microversion: 2.1 time: 0.072206 Jun 17 08:35:52.764893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 22/39] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:52 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:52.775030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9c03d9f0-492f-48f2-800c-09d32daa1d4e tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff025ee3790>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:52.779718 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:35:52.802890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for user fb1df28c175c40b7a06d1f94ba780d28 and project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:35:52.821439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:35:52.826349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:35:53.003626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9c03d9f0-492f-48f2-800c-09d32daa1d4e tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/123a78f3-85c5-4072-aad7-78043484344f" status: 200 len: 351 microversion: 2.1 time: 0.239195 Jun 17 08:35:53.021234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 23/40] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:52 2022] GET /compute/v2.1/os-volumes/123a78f3-85c5-4072-aad7-78043484344f => generated 351 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:53.028145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7c75e873-c802-4a38-a702-7f10b78fe429 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff025ec2160>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:53.105349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5431d8b1-5ca8-4f83-bb00-06c6b1bc323d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.739017 Jun 17 08:35:53.107159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 18/41] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:35:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:35:53.117484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-94bf1671-92e4-4e06-bcb3-2797b1ab9e49 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff026702820>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:53.362145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-7c75e873-c802-4a38-a702-7f10b78fe429 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] HTTP exception thrown: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7c75e873-c802-4a38-a702-7f10b78fe429 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Request method failure captured: Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c HTTP/1.1 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzUF1rS5J70LPmUEYVW2yaLYepa8KwNS4YoSMGIWx6LtcmVcOSL2GP2LeAgWWa70CBbrkb02Xfna1NvDvVZH8Bgyrjr3XucSOoGv9IikFo1nzDxG_d8r0Z6aqr_LJVoAJv9EaSdtdH4hgWtyL3tJEhp59T9YsI_jxfam7aTY2Pe1mk Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:35:53.364166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fe87a25072b04f9890e1aab97d6a40ef Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'd260735b-4d16-46ae-879b-e44ae371501c'} Jun 17 08:35:53.365442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. (HTTP 404) (Request-ID: req-3443fb08-47e7-4b9d-b37d-590cce74c6bf) Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.366184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 08:35:53.367179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 08:35:53.368366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7c75e873-c802-4a38-a702-7f10b78fe429 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Returning 404 to user: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7c75e873-c802-4a38-a702-7f10b78fe429 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 404 len: 109 microversion: 2.1 time: 0.342831 Jun 17 08:35:53.369671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:35:53 2022] DELETE /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 109 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:53.377174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-96ed2b0b-5ea4-4e0c-b09d-d75c9e331882 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:53.377808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-96ed2b0b-5ea4-4e0c-b09d-d75c9e331882 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:53.631738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-96ed2b0b-5ea4-4e0c-b09d-d75c9e331882 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:53.642331 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-96ed2b0b-5ea4-4e0c-b09d-d75c9e331882 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1222 microversion: 2.1 time: 0.271834 Jun 17 08:35:53.645194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 25/43] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:53 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:53.668286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1749972541", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40d8f93-627c-4d1e-91ba-cb4a2d9448c9"}], "security_groups": [{"name": "tempest-securitygroup--1865280770"}], "key_name": "tempest-keypair-239148950", "user_data": "}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:35:53.699733 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-94bf1671-92e4-4e06-bcb3-2797b1ab9e49 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.585042 Jun 17 08:35:53.700735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 19/44] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 08:35:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:53.707715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1e526c75-8171-4eff-942e-355c6aed6b12 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Calling method '.version_select at 0x7ff026702dc0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:53.778726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-1e526c75-8171-4eff-942e-355c6aed6b12 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] HTTP exception thrown: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1e526c75-8171-4eff-942e-355c6aed6b12 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Request method failure captured: Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c HTTP/1.1 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzUF1rS5J70LPmUEYVW2yaLYepa8KwNS4YoSMGIWx6LtcmVcOSL2GP2LeAgWWa70CBbrkb02Xfna1NvDvVZH8Bgyrjr3XucSOoGv9IikFo1nzDxG_d8r0Z6aqr_LJVoAJv9EaSdtdH4hgWtyL3tJEhp59T9YsI_jxfam7aTY2Pe1mk Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:35:53.794548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9398f73795f54f46b21bfcecbfd9c980"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 9398f73795f54f46b21bfcecbfd9c980 Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1509705419 Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: fe87a25072b04f9890e1aab97d6a40ef Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1509705419-project Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'd260735b-4d16-46ae-879b-e44ae371501c'} Jun 17 08:35:53.799084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. (HTTP 404) (Request-ID: req-661dbae0-c6d6-4fff-a6c2-3e724d84c6a6) Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.799767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:35:53.800734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:35:53.801690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. Jun 17 08:35:53.802720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:35:53.806297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1e526c75-8171-4eff-942e-355c6aed6b12 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] Returning 404 to user: Volume d260735b-4d16-46ae-879b-e44ae371501c could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:35:53.810721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1e526c75-8171-4eff-942e-355c6aed6b12 tempest-VolumesSnapshotsTestJSON-1509705419 tempest-VolumesSnapshotsTestJSON-1509705419-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c" status: 404 len: 109 microversion: 2.1 time: 0.108899 Jun 17 08:35:53.816402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 20/45] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:35:53 2022] GET /compute/v2.1/os-volumes/d260735b-4d16-46ae-879b-e44ae371501c => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:35:53.879521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:53.880171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:53.913624 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:53.940707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:53.941793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:53.962185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:54.135268 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] validate_networks() for [('f40d8f93-627c-4d1e-91ba-cb4a2d9448c9', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:35:54.515366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:54.557916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7edc2ecc-aaf7-4a26-b691-2580b54bace9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1284 microversion: 2.1 time: 0.738712 Jun 17 08:35:54.561994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 21/46] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:53 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1284 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:54.570348 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4f4b9378-f72a-4b3a-928d-bf9bca01d8d5 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff02560daf0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:54.793801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4f4b9378-f72a-4b3a-928d-bf9bca01d8d5 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.230222 Jun 17 08:35:54.801894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 22/47] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jun 17 08:35:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:54.801894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:54.803678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:54.832129 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:54.836719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:54.840063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:54.841992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:55.070294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:55.082236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5dd1e15f-5f25-4774-a42c-ddd6955a6bd3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1226 microversion: 2.1 time: 0.284330 Jun 17 08:35:55.084931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:54 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1226 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:55.096804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0babf0ca-d34f-4ec8-93b4-8bc41da42434 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff026702af0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.232966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:35:55.233543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:35:55.233891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:35:55.234361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:35:55.234783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:35:55.253440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:55.253898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:55.255840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:55.255840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:55.315475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:35:55.326665 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for user af32d2a5a83546699f5e2caa3def410d and project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:35:55.355239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0babf0ca-d34f-4ec8-93b4-8bc41da42434 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.268922 Jun 17 08:35:55.355824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 24/49] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:55.367046 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-97c9869b-e6d9-4045-a0c1-9270d5a24d7e tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff02562c4c0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.394700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:35:55.400390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:35:55.500221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-97c9869b-e6d9-4045-a0c1-9270d5a24d7e tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136058 Jun 17 08:35:55.500459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:35:55.513503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9ff7ecd7-64e1-402f-bb2d-b294e42c93c0 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff0255b8e50>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.637672 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9ff7ecd7-64e1-402f-bb2d-b294e42c93c0 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128010 Jun 17 08:35:55.638253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 26/51] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:35:55.663897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.667745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:55.681197 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:55.682328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:55.687196 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:55.688173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:55.717886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fbcfdac8-bea9-4748-a107-b91ebb24cb03 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.071322 Jun 17 08:35:55.736734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:35:55.771280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b96ed17c-e8f9-4933-b42f-18b81d0e00ce tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff025e5f310>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.778959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:55.788311 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-187879e5-78ec-4eb4-98d9-725491b8c9cc tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1272 microversion: 2.1 time: 0.147871 Jun 17 08:35:55.792251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:55.801490 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1cb2cc79-d0bc-447e-9df3-3753afe745fe tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:55.802265 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1cb2cc79-d0bc-447e-9df3-3753afe745fe tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:55.966257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1cb2cc79-d0bc-447e-9df3-3753afe745fe tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:55.975452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1cb2cc79-d0bc-447e-9df3-3753afe745fe tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1237 microversion: 2.1 time: 0.180436 Jun 17 08:35:55.976690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 28/54] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:56.023227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b96ed17c-e8f9-4933-b42f-18b81d0e00ce tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.285167 Jun 17 08:35:56.023991 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 27/55] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 08:35:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:56.036305 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-28504715-ae40-4c57-8470-a78d683de7d1 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff0267028b0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:56.107515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:56.108461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:56.127096 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:56.127893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:56.129219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:56.134132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:56.229669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-28504715-ae40-4c57-8470-a78d683de7d1 tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198250 Jun 17 08:35:56.230302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 29/56] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jun 17 08:35:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:35:56.242414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-50c66309-d7a0-4fda-b75a-bf900d0ca5ae tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] Calling method '.version_select at 0x7ff02561dca0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:56.429344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:56.439724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d1ef1f79-93a5-4565-afc8-147fb22aa758 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1274 microversion: 2.1 time: 0.339990 Jun 17 08:35:56.444721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 28/57] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:56 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:56.464840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-50c66309-d7a0-4fda-b75a-bf900d0ca5ae tempest-VolumesTestJSON-1577411567 tempest-VolumesTestJSON-1577411567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.225852 Jun 17 08:35:56.465696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 30/58] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 08:35:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:56.819331 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:56.820470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:56.850632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:56.851561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:56.858618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:56.859462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:56.995557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-04f8e498-1897-4f92-9c2c-818d56193d0f tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:57.000456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-04f8e498-1897-4f92-9c2c-818d56193d0f tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:57.058156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:57.066931 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f04b90a8-a696-47df-a905-6667304a9814 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1272 microversion: 2.1 time: 0.253134 Jun 17 08:35:57.077122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:56 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:57.182859 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-04f8e498-1897-4f92-9c2c-818d56193d0f tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:57.192567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-04f8e498-1897-4f92-9c2c-818d56193d0f tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1237 microversion: 2.1 time: 0.202170 Jun 17 08:35:57.199362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 31/60] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:56 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:57.472258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:57.472918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:57.489017 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:57.492425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:57.493875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:57.512200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:57.704284 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:57.730455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7026f275-f965-4af8-86b7-da7c35faa7a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1280 microversion: 2.1 time: 0.254103 Jun 17 08:35:57.752381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 30/61] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:57 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:58.240955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:58.240955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:58.240955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.240955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.243890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.243890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.245307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:58.245307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:58.245307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.245307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.246693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.246693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.600432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:58.615496 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c2976d3e-1e0d-4835-83fa-2e6b341153ce tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1241 microversion: 2.1 time: 0.405627 Jun 17 08:35:58.616739 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:58 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1241 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:35:58.762615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:58.764005 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:58.799566 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.800383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.801369 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:58.804970 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:58.863899 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:58.880374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5bf1f827-6ab1-4df4-a641-4cf6c74e9db9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.790075 Jun 17 08:35:58.885896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:58 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:59.014141 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:59.027771 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-498ef2c3-4144-4965-9a8b-ccb8cd3d9bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1280 microversion: 2.1 time: 0.265842 Jun 17 08:35:59.028695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:58 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:59.637483 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:59.639548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:59.648854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:59.649986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:59.651065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:59.652084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:59.747923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:35:59.757696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-835e500c-15cd-4a5f-a916-c7f823ca7a70 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1289 microversion: 2.1 time: 0.128072 Jun 17 08:35:59.758868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:59 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:35:59.902682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:35:59.903999 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:35:59.917726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:59.920682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:35:59.921723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:35:59.925030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:00.046520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:00.047179 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:00.065292 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:00.068296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:00.072511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:00.074791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:00.520527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:00.538511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4f130df5-1686-4fee-abc2-2906d1828e2b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.496358 Jun 17 08:36:00.541414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:00 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:00.709422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:00.717362 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2e3e11fa-7efe-4bc6-9643-93629154b1fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.819451 Jun 17 08:36:00.721104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:35:59 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:00.779866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:00.782932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:00.800180 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:00.802829 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:00.803995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:00.809707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:01.074551 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:01.084847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-247248db-86b5-47c2-9077-d70830b5fefa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1295 microversion: 2.1 time: 0.310116 Jun 17 08:36:01.091197 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:00 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1295 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:01.560356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:01.560356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:01.568722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:01.569191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:01.569981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:01.573698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:01.646528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1ff86b2b-ad76-4d54-b704-fc8e3f44caf3 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Action: 'create', calling method: .version_select at 0x7ff025e34b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-66226483", "metadata": {"Type": "work"}}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:02.282990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:02.298790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9a4e4941-0701-446c-95f6-83ad31c288cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.742264 Jun 17 08:36:02.299354 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 36/69] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:01 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:02.312653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:02.315819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:02.341128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:02.342344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:02.345192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:02.346109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:02.738719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:02.992859 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:03.004286 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f9991f4f-d4bb-4cc3-ae10-c87300bba65d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.703414 Jun 17 08:36:03.005577 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 37/70] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:02 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:03.036729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:03.036729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:03.036729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:03.036729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:03.050954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:03.051504 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:03.446454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1ff86b2b-ad76-4d54-b704-fc8e3f44caf3 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.055971 Jun 17 08:36:03.447187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 34/71] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 08:36:01 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2058 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 08:36:03.453615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:03.458395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:03.474981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:03.475586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:03.476535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:03.477068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.113864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:04.143449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a97be86c-7690-47e4-b342-94dc177c6974 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1295 microversion: 2.1 time: 1.135415 Jun 17 08:36:04.153809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 38/72] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:03 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1295 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:04.196061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-402c42c4-5b00-4be2-b560-a68de5f88edd tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff02562cdc0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:04.305395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-402c42c4-5b00-4be2-b560-a68de5f88edd tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 200 len: 351 microversion: 2.1 time: 0.147583 Jun 17 08:36:04.306314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 39/73] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:36:04 2022] GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:04.319776 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:04.320665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:04.337832 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:04.338294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.342592 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:04.343428 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.393705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:04.404327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-302d1706-371c-497f-899e-6e7fa155077a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.955938 Jun 17 08:36:04.405270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 35/74] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:03 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:04.546364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-9b71884f-5f81-4170-a13f-0e16262b938d req-af875111-59fa-4ba0-8ba3-0d6533a51b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a6815c-86aa-4533-a45a-cb9f491842ec", "tag": "11e3e54d-60cb-4de4-854e-6011b75171a7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:04.580577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-9b71884f-5f81-4170-a13f-0e16262b938d req-af875111-59fa-4ba0-8ba3-0d6533a51b68 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:04.587211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-9b71884f-5f81-4170-a13f-0e16262b938d req-af875111-59fa-4ba0-8ba3-0d6533a51b68 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.667506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-9b71884f-5f81-4170-a13f-0e16262b938d req-af875111-59fa-4ba0-8ba3-0d6533a51b68 service nova] Creating event network-changed:11e3e54d-60cb-4de4-854e-6011b75171a7 for instance 57a6815c-86aa-4533-a45a-cb9f491842ec on hv-cinder-80377 Jun 17 08:36:04.668051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-9b71884f-5f81-4170-a13f-0e16262b938d req-af875111-59fa-4ba0-8ba3-0d6533a51b68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 08:36:04.674559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:04.675010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.675805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:04.676238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:04.725886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.compute.rpcapi [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 08:36:04.726828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=124545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 08:36:04.741660 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:04.752002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5fd3ee7d-5f95-4ee3-a7da-2010b55b3ba9 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.439309 Jun 17 08:36:04.752654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 40/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:04 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:04.761849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-222fcf95-517a-4fb4-8a6f-8710bda9e4f3 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354195 Jun 17 08:36:04.768565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 36/76] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:05.021405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-148f133a-6bda-4552-b7c5-cf90d66ab366 req-75f11916-e956-41fe-9ebd-d7c3949d8653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670345b8-567e-4ba2-b484-d6b1dd74b8e7", "tag": "8e23daa6-602c-488f-98a6-1fafaeaa3860"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:05.037559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-148f133a-6bda-4552-b7c5-cf90d66ab366 req-75f11916-e956-41fe-9ebd-d7c3949d8653 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.038298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-148f133a-6bda-4552-b7c5-cf90d66ab366 req-75f11916-e956-41fe-9ebd-d7c3949d8653 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.064608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-148f133a-6bda-4552-b7c5-cf90d66ab366 req-75f11916-e956-41fe-9ebd-d7c3949d8653 service nova] Creating event network-changed:8e23daa6-602c-488f-98a6-1fafaeaa3860 for instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 on hv-cinder-80377 Jun 17 08:36:05.065545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-148f133a-6bda-4552-b7c5-cf90d66ab366 req-75f11916-e956-41fe-9ebd-d7c3949d8653 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 08:36:05.067340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.067992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.069398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.070279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.086890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.compute.rpcapi [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 08:36:05.089827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] Releasing lock "compute-rpcapi-router" {{(pid=124546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 08:36:05.124986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-07a67905-e5d5-495a-ab50-8a1256ce456b None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370301 Jun 17 08:36:05.132658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 41/77] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:05.167226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:05.168436 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:05.178328 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.179703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.181311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.183457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.327869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9cd14963-920f-4552-aa61-8527c7744e57 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff02562c550>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:05.361237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=22 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:05.445475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9cd14963-920f-4552-aa61-8527c7744e57 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 200 len: 352 microversion: 2.1 time: 0.126918 Jun 17 08:36:05.460673 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 42/78] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:36:05 2022] GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:05.481777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:05.481777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:05.481777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.481777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.482119 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.482257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.705629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:05.713648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-125efbd2-0845-4849-9dce-e4d936d5c669 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.553761 Jun 17 08:36:05.722736 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 37/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:05 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:05.736227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-57fe1618-7c44-40df-b15f-e455b4a23034 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff025e12c10>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:05.840200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-57fe1618-7c44-40df-b15f-e455b4a23034 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 200 len: 352 microversion: 2.1 time: 0.115929 Jun 17 08:36:05.843216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 38/80] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:36:05 2022] GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:05.849720 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:05.851829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:05.879938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.893724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:05.897567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:05.898275 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:06.236267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:06.246387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-88aa0d2d-d65f-4520-895d-4694d6330220 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.784207 Jun 17 08:36:06.251638 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:05 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:06.272360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8fb31729-674d-432e-9e1e-35a632e8784d tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff02562caf0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:06.428479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:06.439499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ea6a6dea-d1e7-4d92-9d2a-e3be9a842b28 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.594483 Jun 17 08:36:06.445005 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 39/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:05 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:06.551821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8fb31729-674d-432e-9e1e-35a632e8784d tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 202 len: 0 microversion: 2.1 time: 0.298928 Jun 17 08:36:06.559724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 44/83] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:36:06 2022] DELETE /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:36:06.561718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-855b5705-5bb9-412a-97a1-64552d7480c1 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff025e12790>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:06.746424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:06.747208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:06.760440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:06.763384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:06.763384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:06.763384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:07.182630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-855b5705-5bb9-412a-97a1-64552d7480c1 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 200 len: 351 microversion: 2.1 time: 0.625484 Jun 17 08:36:07.188511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 40/84] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:36:06 2022] GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 351 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:36:07.192659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=20 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:07.210885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-4f1d68fb-fa7b-431b-8338-09c93cccb3e0 req-f6d765c9-203a-4bc1-a06a-6d9588eac92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8717f6aa-b085-47bb-b1cf-2d52ba7a84c8", "tag": "92dbd3ea-5920-4627-a3de-530b8b0e917c"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:07.232226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4f1d68fb-fa7b-431b-8338-09c93cccb3e0 req-f6d765c9-203a-4bc1-a06a-6d9588eac92c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:07.232837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4f1d68fb-fa7b-431b-8338-09c93cccb3e0 req-f6d765c9-203a-4bc1-a06a-6d9588eac92c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:07.258967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-4f1d68fb-fa7b-431b-8338-09c93cccb3e0 req-f6d765c9-203a-4bc1-a06a-6d9588eac92c service nova] Creating event network-changed:92dbd3ea-5920-4627-a3de-530b8b0e917c for instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 on hv-cinder-80377 Jun 17 08:36:07.272045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-4f1d68fb-fa7b-431b-8338-09c93cccb3e0 req-f6d765c9-203a-4bc1-a06a-6d9588eac92c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064903 Jun 17 08:36:07.273924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 41/85] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:36:07.284380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:07.286030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:07.293945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:07.294845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:07.295848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:07.296528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:07.761455 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:07.773181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-afc5dfa0-fc65-48c2-a25f-cd429a139543 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 1.031115 Jun 17 08:36:07.775030 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 45/86] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:06 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:07.786887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:07.788534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:07.804397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:07.804916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:07.806183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:07.812314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:08.161231 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:08.168412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-67d90a97-1786-49f8-babe-604e00313473 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.893085 Jun 17 08:36:08.183105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 42/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:07 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:08.195115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2d773e62-db76-4cc4-b1a0-15c3960e1869 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Calling method '.version_select at 0x7ff025e129d0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:08.249403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-2d773e62-db76-4cc4-b1a0-15c3960e1869 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] HTTP exception thrown: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2d773e62-db76-4cc4-b1a0-15c3960e1869 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Request method failure captured: Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd HTTP/1.1 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzxkeIbh2HDwo20bpBf6gYrpnB0Jpvp0FSo9bFMO_T8omuliKmALKNvTD4TOdX9jaZOFlzv2JxQQgfnXjWAKTl5I6OQVpRsGde2cSyI-UsCLCUr0sZngWaWFdresitvsn-C2xPtLYOeP7DcZk8aNv1u8kkXbQcV-U8zC0k7sXKQA0s Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: f0216b5fbc2a4456bd139fc18724f073 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesGetTestJSON-572946289 Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:36:08.254233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0216b5fbc2a4456bd139fc18724f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f0216b5fbc2a4456bd139fc18724f073"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f0216b5fbc2a4456bd139fc18724f073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0216b5fbc2a4456bd139fc18724f073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesGetTestJSON-572946289 Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: f0216b5fbc2a4456bd139fc18724f073 Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesGetTestJSON-572946289 Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesGetTestJSON-572946289-project Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 908d2ee68b1a4da1b958e00db174db07 Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesGetTestJSON-572946289-project Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '83286c3f-1866-450d-b6d8-281601f2d2bd'} Jun 17 08:36:08.255501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. (HTTP 404) (Request-ID: req-35e7c519-d490-40e6-a972-257ce1d1275b) Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:36:08.256265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 08:36:08.257659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 08:36:08.258577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. Jun 17 08:36:08.259599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:36:08.261708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2d773e62-db76-4cc4-b1a0-15c3960e1869 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] Returning 404 to user: Volume 83286c3f-1866-450d-b6d8-281601f2d2bd could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:36:08.262794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2d773e62-db76-4cc4-b1a0-15c3960e1869 tempest-VolumesGetTestJSON-572946289 tempest-VolumesGetTestJSON-572946289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd" status: 404 len: 109 microversion: 2.1 time: 0.071500 Jun 17 08:36:08.263765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 08:36:08 2022] GET /compute/v2.1/os-volumes/83286c3f-1866-450d-b6d8-281601f2d2bd => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:36:08.329998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:08.343261 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-404a3c26-0373-4970-b814-377dcacefbd5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.566927 Jun 17 08:36:08.347028 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 46/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:07 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:08.791292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:08.792535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:08.803384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:08.804218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:08.805281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:08.805898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.152435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-344eac81-9822-4861-81ee-d51694459db1 req-7e132684-44a3-46af-91e0-1febff381b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d680267-4032-4899-9999-bd8fe751264c", "tag": "8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:09.192169 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:09.197100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-344eac81-9822-4861-81ee-d51694459db1 req-7e132684-44a3-46af-91e0-1febff381b44 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:09.203525 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-344eac81-9822-4861-81ee-d51694459db1 req-7e132684-44a3-46af-91e0-1febff381b44 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.211506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2de46681-69e8-4a64-9513-ee8f938d8ba2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.424368 Jun 17 08:36:09.222895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:08 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:09.247153 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:09.254248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:09.274818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-344eac81-9822-4861-81ee-d51694459db1 req-7e132684-44a3-46af-91e0-1febff381b44 service nova] Creating event network-changed:8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b for instance 6d680267-4032-4899-9999-bd8fe751264c on hv-cinder-80377 Jun 17 08:36:09.284705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:09.289624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.289624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:09.289624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.290161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-344eac81-9822-4861-81ee-d51694459db1 req-7e132684-44a3-46af-91e0-1febff381b44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141953 Jun 17 08:36:09.293730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 47/91] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:09.366820 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:09.367784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:09.380596 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:09.386750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.386750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:09.386750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:09.846464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:09.856454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-615912d1-b09d-4807-929f-4c08dc176ead tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.631166 Jun 17 08:36:09.860571 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 45/92] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:09 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:09.958170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:09.970433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c71c4440-9772-43bb-b60b-539f00ac85fe tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.606429 Jun 17 08:36:09.973338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 48/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:09 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:10.233495 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:10.235753 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:10.246966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.247428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:10.252125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.252627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:10.555018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:10.572445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8eb9d251-16e5-4be2-aedd-ea068d12b819 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.337198 Jun 17 08:36:10.572445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 46/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:10 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:10.879078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:10.879729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:10.891775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.892234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:10.893044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.893581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:10.897891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:10.990499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:10.991084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:10.997239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.997686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:10.998453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:10.998891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:11.017926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:11.224524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:11.235964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-16b26c4b-5590-4632-a157-a0c487a3437e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.361854 Jun 17 08:36:11.252341 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 49/95] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:10 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:11.276591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:11.283981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-876a0342-d2f1-4b6b-bf69-a11d7dcfc7a2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.296853 Jun 17 08:36:11.285704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 47/96] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:10 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:11.595780 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:11.596753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:11.605662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:11.606287 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:11.607060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:11.613244 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:11.802027 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:11.814208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-04cbc953-7a3c-4c3c-a2e3-ecd197b848e5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.222519 Jun 17 08:36:11.815190 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 50/97] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:11 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:12.259913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:12.260848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:12.269972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.276221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:12.276221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.276221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:12.305492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:12.305492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:12.311957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.312828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:12.313772 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.314275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:12.479901 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:12.487864 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1337595e-5104-40af-9f1a-31b50d23e4c6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.232424 Jun 17 08:36:12.488441 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 48/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:12 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:12.518904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:12.526501 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1bbb209f-192e-4ed5-a8d6-6ec299894ebd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.227188 Jun 17 08:36:12.527250 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:12 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:12.831829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:12.832475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:12.838654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.839103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:12.839873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:12.840312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:13.029286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:13.037869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c6029034-e9a3-40ab-af83-8af1a3feced9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.210486 Jun 17 08:36:13.038549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 49/100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:12 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:13.505117 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:13.505879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:13.512066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:13.512642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:13.513598 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:13.514122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:13.543396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:13.544015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:13.551663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:13.553528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:13.553528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:13.554005 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:13.738809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:13.747741 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c4b08110-f97b-49d3-9663-15dbdabe7e1f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.246311 Jun 17 08:36:13.748608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:13 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:13.770167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:13.778518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f05c2fb5-3cfc-4df5-920c-41596a77476a tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.238987 Jun 17 08:36:13.779101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 50/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:13 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:14.063826 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:14.064149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:14.076164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.078020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.080776 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.081237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.226792 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:14.250242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-dd8a1eee-e28d-4a3c-baa3-bcbae4cadf0c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.192466 Jun 17 08:36:14.252608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:14 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:14.765204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:14.766740 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:14.768406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=8 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:14.770123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:14.778907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.778907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.778907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.778907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.801810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:14.802477 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:14.808913 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.809359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.810117 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:14.810545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:14.963701 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:14.973056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-83aa576d-4217-40cc-b092-972e5fe1b9a9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.211139 Jun 17 08:36:14.983680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 51/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:14 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:14.995939 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:15.005597 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2fb3ef97-bbbf-408f-8fbe-b79f7e181597 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.207489 Jun 17 08:36:15.006484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 54/105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:14 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:15.268460 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:15.269114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:15.275027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:15.275468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:15.276227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:15.276695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:15.420707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:15.430847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bb3e1394-4e38-417e-86b0-e4d567dab1bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.167056 Jun 17 08:36:15.431764 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 52/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:15 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:15.990025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:15.990815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:15.993019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:15.993805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:15.999110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:15.999593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.001078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:16.001515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.024049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:16.024678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:16.032205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:16.032679 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.033446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:16.033874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.195025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:16.205233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6ddeca2d-f38e-4947-91fc-4bc8d6905108 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.219520 Jun 17 08:36:16.205940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 55/107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:15 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:16.237774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:16.245407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6399cad5-09fd-4558-93b0-2ee41e2c0fc7 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.225694 Jun 17 08:36:16.246138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 53/108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:16 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:16.448236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:16.448957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:16.456471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:16.456910 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.457813 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:16.458324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:16.592271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:16.600760 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1d2cee8d-0b5e-457d-9919-f538f5a3e095 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.156467 Jun 17 08:36:16.601329 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:16 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:17.222706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:17.223325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:17.229621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.230075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.230841 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.231278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.262917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:17.263677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:17.270922 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.271642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.272550 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.273126 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.417910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:17.434877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c13492d8-265c-43f0-a1c4-cf6b2900a46d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.212172 Jun 17 08:36:17.434877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 54/110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:17 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:17.465563 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:17.475576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ea6a9fbf-df97-49a1-8843-c46f4159962b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.216369 Jun 17 08:36:17.476342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 57/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:17 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:17.618172 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:17.618847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:17.625383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.625913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.626756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:17.627275 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:17.760001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:17.767735 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-020e742f-d6dc-44b5-8a6a-3a6aea5b1ca7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.153443 Jun 17 08:36:17.768304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 55/112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:17 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:18.448449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:18.449091 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:18.456003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.456456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.457252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.457694 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.494394 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:18.494394 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:18.501076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.501584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.503203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.503203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.653387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:18.661076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-35df6e7b-ed22-494e-bc6b-ab07c12375d9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.216762 Jun 17 08:36:18.661657 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:18 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:18.683335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:18.691341 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ef78823e-8fa2-4fce-81d8-14d946ad7ac0 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.202169 Jun 17 08:36:18.691889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 56/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:18 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:18.784721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:18.785334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:18.791452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.791902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.792696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:18.793128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:18.924843 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:18.932545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f3935d73-a5c9-4f61-8d63-5e41fe627dc5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.151973 Jun 17 08:36:18.933100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 59/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:18 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:19.679722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:19.680332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:19.686323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.686770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:19.687538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.688700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:19.707339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:19.708593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:19.715101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.715818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:19.717268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.717941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:19.893184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:19.900991 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f5e562f9-f57b-4e3e-83a2-6935b89fd2c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.225095 Jun 17 08:36:19.901794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 57/116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:19 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:19.908000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:19.925326 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3aa9935a-75c9-4dd4-a2da-1c665278083b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.221994 Jun 17 08:36:19.925898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 60/117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:19 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:19.957138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:19.958111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:19.966398 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.967251 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:19.968282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:19.969761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:20.147221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:20.155005 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8cbedb2c-4176-40f8-aefc-c5f81c82575b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.205086 Jun 17 08:36:20.156951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 58/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:19 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:20.918304 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:20.918923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:20.926038 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:20.926490 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:20.927264 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:20.927731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:20.946059 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:20.946662 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:20.952644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:20.953081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:20.953922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:20.954588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:21.126566 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:21.132964 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:21.137804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2ddadc09-5bca-4384-8997-2cc312cecea2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.223422 Jun 17 08:36:21.138705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 61/119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:20 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:21.145974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2f6321b5-2a5c-46a3-a133-fb36023a2a26 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.203794 Jun 17 08:36:21.146544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 59/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:20 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:21.172152 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:21.173116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:21.179533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:21.180005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:21.180830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:21.181266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:21.331869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:21.339578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b2192fd2-d991-4b55-ac64-e543ff46333d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.171173 Jun 17 08:36:21.340147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 62/121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:21 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:22.155095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:22.164650 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:22.164650 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.164650 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.164650 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.164967 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:22.165386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.165466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:22.171063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.171400 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.172164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.172686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.367488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:22.371990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:22.375759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dc592628-260f-48d1-85b8-47722d3a848b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.224468 Jun 17 08:36:22.376985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 60/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:22 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:22.382024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:22.382872 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:22.383634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0cc2d221-1ed0-4cb7-8531-06f7f1f6f82b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.223681 Jun 17 08:36:22.393433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 63/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:22 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:22.393777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.393777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.394410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:22.394994 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:22.527695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:22.535190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2bdae8df-2080-4f9d-8f24-ec3f19df8f79 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.156935 Jun 17 08:36:22.535757 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 61/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:22 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:23.393749 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:23.394388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:23.400397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.400875 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.400993 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:23.401501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:23.401634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.402061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.408067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.412360 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.412360 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.412360 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.598324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:23.602305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:23.605915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-94b4d1b9-2b03-40ee-b3bc-f088f71b7f17 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.216709 Jun 17 08:36:23.606488 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 64/125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:23 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:23.610183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-149c4ff5-7396-4890-8350-07beef1f9754 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.212752 Jun 17 08:36:23.611335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:23.611675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 62/126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:23 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:23.611937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:23.617991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.618441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.619202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:23.619633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:23.749175 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:23.753746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:23.758217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-420e9758-bde9-460d-b5ea-487554c3004e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.150780 Jun 17 08:36:23.758794 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 65/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:23 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:24.623049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:24.623554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:24.627463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:24.628083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:24.630959 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.631399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.632154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.632612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.634486 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.634940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.635702 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.636137 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.831533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:24.835653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:24.840438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a0bc5295-0db0-4b00-a2c8-61ad9144b9be tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.221249 Jun 17 08:36:24.841054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 63/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:24 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:24.843715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f5554763-dc99-41e7-8891-1f2d5b36458f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.220610 Jun 17 08:36:24.844346 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 66/129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:24 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:24.846146 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:24.846756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:24.852848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.853565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.854327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:24.854761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:24.858639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:24.994537 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:25.003178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ca3a47f6-f5b0-4848-8051-8bd5e5840d80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.160810 Jun 17 08:36:25.003858 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 64/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:24 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:25.858096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:25.859449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:25.861206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:25.861824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:25.867809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:25.868413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:25.869092 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:25.869369 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:25.869536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:25.869821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:25.870507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:25.870969 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:26.081774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:26.085774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:26.090098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5320f012-3abf-4798-b460-01117552bd18 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.236321 Jun 17 08:36:26.090971 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 67/131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:25 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:26.095914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bc668058-bf2b-42b9-8ce0-37e7893e6f12 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.237241 Jun 17 08:36:26.095914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 65/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:25 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:26.104341 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:26.104996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:26.112387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:26.112952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:26.113899 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:26.114431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:26.246451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:26.255462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c83a29d2-1c07-4e2c-8e50-982660f3bccd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.160210 Jun 17 08:36:26.260141 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:26 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:27.108181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:27.108915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:27.110827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:27.111455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:27.115645 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.116095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.116891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.117320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.117969 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.118418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.119185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.119622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.310358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:27.314411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:27.318089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5c74714e-97c2-450f-a3e9-fff8eda1a1fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.213909 Jun 17 08:36:27.318661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 68/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:27 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:27.322084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4e3c7245-5950-4cb7-bf32-7c9a8f465b8c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.215528 Jun 17 08:36:27.322807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 67/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:27 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:27.323059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:27.323667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:27.330116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.330561 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.331330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:27.331767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:27.457996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:27.465339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f2654178-8600-481f-891a-03dbb4844183 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.145743 Jun 17 08:36:27.465936 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:27 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:28.334721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:28.335333 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:28.338848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:28.339467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:28.341462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.341911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.342673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.343104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.346066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.346515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.347280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.347719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.537316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:28.544749 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:28.545525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1c6ecb95-6d3b-4a12-9ac7-3714af4fb1df tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.214612 Jun 17 08:36:28.546274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:28 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:28.553444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:28.553444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:28.553693 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5aaf2425-d759-424e-84df-8f31964ed2d1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.218202 Jun 17 08:36:28.554268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:28 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:28.559829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.560273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.561074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:28.561510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:28.693064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:28.700610 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7879add6-f8eb-4baf-90fa-91a20646929a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.153281 Jun 17 08:36:28.701168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:28 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:29.565109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:29.565717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:29.569981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:29.570604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:29.571862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.572309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.573467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.573597 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.576479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.576962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.577728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.578165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.763927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:29.767922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:29.771636 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e1dad46c-03aa-4ab7-925e-8fbaed8e54cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.211035 Jun 17 08:36:29.772204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 71/140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:29 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:29.776605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:29.777204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:29.783551 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.784000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.784787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:29.785218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:29.785323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5b3f6df2-366c-4e5e-83b4-6753661b52c3 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.218906 Jun 17 08:36:29.785884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:29 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:29.917503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:29.925635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6ef975cd-875d-4e33-98d1-b26b7eef2210 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.152462 Jun 17 08:36:29.926197 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 72/142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:29 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:30.788927 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:30.789535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:30.795496 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:30.796034 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:30.796819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:30.797253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:30.801611 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:30.802421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:30.808416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:30.808897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:30.809667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:30.810103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:31.180303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:31.183002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:31.192543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-17993815-888f-4244-b6a6-ba28f519e54e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.407748 Jun 17 08:36:31.193031 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cc504784-aae3-470b-b9cb-261b1e9423ca tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.395725 Jun 17 08:36:31.193448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:30 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:31.193596 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 73/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:30 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:31.200521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:31.201283 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:31.208577 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:31.208976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:31.209746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:31.210208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:31.267160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-ec3f0be8-f425-417a-847c-553bead66b01 req-fc63251b-f72e-4ab2-a18b-85c9e6e8fdbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a6815c-86aa-4533-a45a-cb9f491842ec", "name": "network-vif-plugged", "status": "completed", "tag": "11e3e54d-60cb-4de4-854e-6011b75171a7"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:31.275380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ec3f0be8-f425-417a-847c-553bead66b01 req-fc63251b-f72e-4ab2-a18b-85c9e6e8fdbb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:31.275838 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ec3f0be8-f425-417a-847c-553bead66b01 req-fc63251b-f72e-4ab2-a18b-85c9e6e8fdbb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:31.286951 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-ec3f0be8-f425-417a-847c-553bead66b01 req-fc63251b-f72e-4ab2-a18b-85c9e6e8fdbb service nova] Creating event network-vif-plugged:11e3e54d-60cb-4de4-854e-6011b75171a7 for instance 57a6815c-86aa-4533-a45a-cb9f491842ec on hv-cinder-80377 Jun 17 08:36:31.292048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-ec3f0be8-f425-417a-847c-553bead66b01 req-fc63251b-f72e-4ab2-a18b-85c9e6e8fdbb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097363 Jun 17 08:36:31.292679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 74/145] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:31.344965 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:31.352513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e6c62ffe-482d-4a9b-8621-ae734b6b5ea3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.157901 Jun 17 08:36:31.362420 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 72/146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:31 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:32.209733 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:32.210224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:32.210581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:32.210959 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:32.217627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.217754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.218098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.218482 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.218868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.219258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.219361 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.219698 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.418928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:32.426645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:32.428995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6f3293ac-3113-4820-8278-74fe8223025d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.223620 Jun 17 08:36:32.437409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 75/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:32 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:32.447507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:32.447507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:32.447782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-77ee97e7-679d-4b84-a1ae-924cf2e9357e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.235347 Jun 17 08:36:32.447782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 73/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:32 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:32.447940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.447940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.447940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:32.447940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:32.579927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:32.588303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9486b9ef-5bb4-4f2b-ba7e-3d8f0633e6ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.154197 Jun 17 08:36:32.588904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 76/149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:32 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:33.447176 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:33.447903 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:33.454165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.454666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.455427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.457311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.462481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:33.463100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:33.470608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.470608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.470608 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.470902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.667273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:33.670760 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:33.675725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-860cdbf0-c792-468d-84e8-db62f3020fa0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.233676 Jun 17 08:36:33.676287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 74/150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:33 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:33.681745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:33.682447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:33.687925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-83de905f-59f3-4275-ae97-eb5151235219 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.229239 Jun 17 08:36:33.688296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.688556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:33 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:33.688783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.689660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:33.690103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:33.816941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:33.824324 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-937dd109-ef50-41d2-a642-224fa42021ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.146350 Jun 17 08:36:33.824925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 75/152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:33 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:34.692693 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:34.693834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:34.699762 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.700219 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.701026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.701467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.705423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:34.706327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:34.713372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.714065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.715151 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.715712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.904883 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:34.911243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:34.912639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0bfc4681-d790-44b4-8704-901bff7a2cc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.223500 Jun 17 08:36:34.913190 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 78/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:34 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:34.917856 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:34.918458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:34.924746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.925200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.925999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:34.926441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:34.926926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-07c83ea5-d677-4077-b775-0a133d5179f1 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.225338 Jun 17 08:36:34.928010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 76/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:34 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:35.053450 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:35.060890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a1cfe7ae-705f-4b70-a175-ead3e613576d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.146458 Jun 17 08:36:35.061464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:34 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:35.929873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:35.930441 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:35.937224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:35.937667 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:35.938491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:35.938918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:35.943785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:35.945222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:35.951617 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:35.952065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:35.952869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:35.953506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:36.140681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:36.148677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:36.148998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-48c5ea48-47c6-4295-b391-557828097bf8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.223461 Jun 17 08:36:36.149573 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:35 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:36.154235 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:36.155661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:36.157994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-41b640ae-9c22-4361-8250-c923a45aab38 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.217934 Jun 17 08:36:36.158909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 80/157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:35 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:36.162588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:36.163519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:36.164475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:36.164948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:36.296769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:36.304630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cb7c405b-80ef-4563-8467-7ac4c55adc8d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.153845 Jun 17 08:36:36.305183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 78/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:36 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:37.166024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:37.166640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:37.173357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.173810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.174586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.175022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.177206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:37.178408 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:37.186041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.186466 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.187192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.187625 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.386443 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:37.394268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5effa2ee-e325-4567-949d-e1182c5cb1bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.232694 Jun 17 08:36:37.394886 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 81/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:37 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:37.398395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:37.400938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:37.401654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:37.408101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.408671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.409521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:37.410061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:37.416878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-efefaaff-4bae-4b3f-9d03-2cc64371f45d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.243916 Jun 17 08:36:37.417564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:37 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:37.547613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:37.555505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8ff0c0c8-5500-49f8-b398-409aada9027b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.159153 Jun 17 08:36:37.559387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:37 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:38.410833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:38.411447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:38.418006 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.418453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.419216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.419644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.445026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:38.445644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:38.451805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.452252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.453147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.453586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.457898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.611852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:38.615289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.619793 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8633c2e4-74c0-4c91-a2c4-4f9417a704ab tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.212685 Jun 17 08:36:38.620367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:38 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:38.624949 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:38.625617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:38.631478 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.632071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.632886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:38.633322 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:38.633969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:38.641557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-395e721d-4a36-4276-a7c8-275100040c3d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.200628 Jun 17 08:36:38.642301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 83/163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:38 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:38.774992 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:38.782459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2fd64084-50e7-4082-8a2b-db3a68f96188 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.161092 Jun 17 08:36:38.783027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:38 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:39.637667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:39.638290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:39.644280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.644757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:39.645520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.645949 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:39.659314 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:39.659847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:39.666402 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.667053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:39.667711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.668138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:39.845221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:39.849167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:39.853511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ca3fc810-fe78-4c74-82c2-2314ca50626e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.219842 Jun 17 08:36:39.854089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 84/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:39 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:39.858534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:39.859143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:39.860523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5eb5322a-69e2-4d6d-aad9-8dc888ec6d6b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.205038 Jun 17 08:36:39.861226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:39 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:39.865316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.865827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:39.867200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:39.867639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:40.000432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:40.008345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fb0e2c1e-7eb0-4c03-a629-8d97273af109 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.153318 Jun 17 08:36:40.008939 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 85/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:39 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:40.871606 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:40.872219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:40.878461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:40.878915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:40.878915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:40.879683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:40.880124 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:40.880262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:40.887279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:40.888132 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:40.888953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:40.889388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:41.132889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:41.138963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:41.140874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8182b992-0188-4a54-8bb3-7367505aa974 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.273006 Jun 17 08:36:41.141816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 83/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:40 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:41.146844 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bd2727eb-0bb4-41c1-9a6a-99b14bd0fc77 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.272225 Jun 17 08:36:41.147216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-ce9f9a12-80db-4f16-a72e-fdd45322b074 req-f60280fd-38f7-4f14-9db9-fefe5b2e9634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8717f6aa-b085-47bb-b1cf-2d52ba7a84c8", "name": "network-vif-plugged", "status": "completed", "tag": "92dbd3ea-5920-4627-a3de-530b8b0e917c"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:41.148201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 86/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:40 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:41.153120 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:41.153900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:41.156078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ce9f9a12-80db-4f16-a72e-fdd45322b074 req-f60280fd-38f7-4f14-9db9-fefe5b2e9634 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:41.156631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ce9f9a12-80db-4f16-a72e-fdd45322b074 req-f60280fd-38f7-4f14-9db9-fefe5b2e9634 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:41.161649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:41.163905 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:41.165534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:41.166268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:41.170311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-ce9f9a12-80db-4f16-a72e-fdd45322b074 req-f60280fd-38f7-4f14-9db9-fefe5b2e9634 service nova] Creating event network-vif-plugged:92dbd3ea-5920-4627-a3de-530b8b0e917c for instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 on hv-cinder-80377 Jun 17 08:36:41.176705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-ce9f9a12-80db-4f16-a72e-fdd45322b074 req-f60280fd-38f7-4f14-9db9-fefe5b2e9634 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Jun 17 08:36:41.177510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 84/170] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:41.318645 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:41.326549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ee2d3db8-a5e2-4643-af29-f8e362f91cd8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.177241 Jun 17 08:36:41.327104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 87/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:41 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:42.159038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:42.159779 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:42.163705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:42.164325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:42.166739 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.167190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.167957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.168391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.170360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.170896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.171655 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.172091 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.365031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:42.368383 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:42.372473 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-05e99922-3f33-4cc0-a53b-a8381999ce37 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.217656 Jun 17 08:36:42.373274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 85/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:42 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:42.377865 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:42.378428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:42.379954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0abb2314-9bd7-4f87-918e-f07d99905c33 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.220168 Jun 17 08:36:42.380659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 88/173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:42 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:42.385668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.386117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.387132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:42.387539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:42.556449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:42.564685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a01ed6d0-84e5-4126-864d-1cb841322590 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.190285 Jun 17 08:36:42.566342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:42 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:43.395153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:43.398439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:43.402790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:43.403300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.403300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.404105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.404584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.404714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:43.411564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.412173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.414238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.414858 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.661658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:43.672222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9e5197b9-0db4-428d-a11e-1801d9ff0301 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.280862 Jun 17 08:36:43.673291 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 89/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:43 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:43.681661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:43.684356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:43.685193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:43.691274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d88c4dcf-c6b7-40dd-b42b-20bc0f7be223 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.294003 Jun 17 08:36:43.691731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.692365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.693177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:43.694100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:43.700624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 87/176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:43 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:43.870898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:43.878350 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0032cc89-2145-4312-9a0f-d930770ccdb7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.198446 Jun 17 08:36:43.878910 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 90/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:43 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:44.690274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:44.690890 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:44.697660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.698119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:44.698888 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.699360 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:44.712615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:44.713902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:44.720293 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.722128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:44.722128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.722128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:44.914742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:44.920892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:44.924876 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3ed2c0d7-4a29-4c09-903a-ccba4d39c23b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.238547 Jun 17 08:36:44.935197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:44 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:44.936350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:44.936748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:44.946894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-77d0d9bb-5f6c-46be-a649-d1c2a3341533 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.235160 Jun 17 08:36:44.946894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:44 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:44.948615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.949852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:44.950849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:44.952064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:45.151202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:45.160358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-99dd9925-d7ba-43b3-a5ad-d3d1933abee8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.232738 Jun 17 08:36:45.161140 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 89/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:44 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:45.946113 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:45.946959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:45.953324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:45.957735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:45.957735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:45.957735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:45.968397 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:45.969523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:45.978811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:45.979164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:45.980134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:45.980712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:46.204451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:46.213115 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:46.218947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1ccd1235-aee3-4ee2-9594-692703a0d1fd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.255628 Jun 17 08:36:46.219826 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:45 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:46.223375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-69eea9e8-d445-4621-87dd-a818337f00e6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.281276 Jun 17 08:36:46.224234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:45 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:46.226797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:46.227658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:46.235223 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:46.236254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:46.237227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:46.238087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:46.402472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:46.410015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-be59dc13-ecaa-4ac6-b184-5a748d575ef6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.189014 Jun 17 08:36:46.410562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:46 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:47.238498 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:47.239113 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:47.241461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:47.242079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:47.245615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.246138 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.246993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.247446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.248000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.248453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.249299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.249746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.454449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:47.460014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:47.463958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cb872c42-451c-4dc4-9fba-8ffa185d981e tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.229781 Jun 17 08:36:47.465810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:47 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:47.469143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:47.469743 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:47.470669 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c8aa6b71-3786-4fc2-a4ab-106c98559e6f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.232358 Jun 17 08:36:47.471626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 92/185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:47 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:47.480699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.481231 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.482087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:47.482556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:47.676688 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:47.686055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6c4f4ca2-bfeb-4585-965f-e13188d1ec20 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.220471 Jun 17 08:36:47.686870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:47 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:48.481724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:48.482340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:48.484996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=83 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.488677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:48.489468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:48.491125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.491125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.491812 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.492239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.493395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=80 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.496921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.497367 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.498147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.498576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.721839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:48.738093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0c58deb3-265d-46be-a9b6-4094566e7982 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.260091 Jun 17 08:36:48.738758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 93/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:48 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:48.744450 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:48.749237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:48.751430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.752063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.752925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:48.753316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:48.753522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:48.764941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d7338b94-3c86-4fd0-8b39-6d627541783f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.280204 Jun 17 08:36:48.765520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 95/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:48 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:48.898769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:48.906848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2a451b70-273d-489e-b226-aff5a97a64d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.166894 Jun 17 08:36:48.907512 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:48 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:49.288077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-9539340d-3ef7-4897-aab1-ef632223c6e0 req-b391c248-5fbe-47c8-978c-bddb86b27c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d680267-4032-4899-9999-bd8fe751264c", "name": "network-vif-plugged", "status": "completed", "tag": "8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:49.297311 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-9539340d-3ef7-4897-aab1-ef632223c6e0 req-b391c248-5fbe-47c8-978c-bddb86b27c6c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:49.297757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-9539340d-3ef7-4897-aab1-ef632223c6e0 req-b391c248-5fbe-47c8-978c-bddb86b27c6c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:49.310590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-9539340d-3ef7-4897-aab1-ef632223c6e0 req-b391c248-5fbe-47c8-978c-bddb86b27c6c service nova] Creating event network-vif-plugged:8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b for instance 6d680267-4032-4899-9999-bd8fe751264c on hv-cinder-80377 Jun 17 08:36:49.317241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-9539340d-3ef7-4897-aab1-ef632223c6e0 req-b391c248-5fbe-47c8-978c-bddb86b27c6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033666 Jun 17 08:36:49.318258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 96/190] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:36:49.757631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:49.759298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:49.767855 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:49.768612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:49.769319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:49.769868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:49.790564 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:49.793368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:49.810097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:49.810953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:49.811966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:49.813374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:50.109770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:50.131182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b0ef3e8b-0be6-4435-8a08-f950f1749522 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.378157 Jun 17 08:36:50.132962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 95/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:49 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:50.141868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:50.155649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6152e8ac-b392-4bab-9621-b471a73c1fa5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.371896 Jun 17 08:36:50.160251 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:50.160907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:50.167227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 97/192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:49 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:50.167953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:50.168400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:50.169546 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:50.169983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:50.625746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:50.640208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-258a5d83-5555-4365-8594-9aa5352b0358 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.503197 Jun 17 08:36:50.640821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 96/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:50 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:51.150476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:51.151188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:51.157924 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.158704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.159534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.159969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.174782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:51.176107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:51.187856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.187856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.187856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.187856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.400292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:51.403349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:51.407797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8437dbca-da33-4228-a1c2-78ff520a5a60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.236736 Jun 17 08:36:51.411493 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 97/194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:51 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:51.411603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1db552fe-2df4-4846-8df9-d5ea510101b2 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.265431 Jun 17 08:36:51.411603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 98/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:51 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:51.658960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:51.659677 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:51.666434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.666969 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.667830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:51.668553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:51.673190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:51.812332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:51.819668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f13336a2-f6cd-4fa2-a1f9-c411329585db tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.164633 Jun 17 08:36:51.820227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:51 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:52.427615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:52.428436 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:52.429158 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:52.429603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:52.436014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.436731 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.437134 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.437587 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.438417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.438788 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.439168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.439560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.642753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:52.652371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d8af8969-6cc2-4915-a41c-e2312c7d5f7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.229432 Jun 17 08:36:52.659227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 99/197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:52 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:52.659337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:52.662749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-055c29ea-b353-4343-b612-ae3d3fbc6ff6 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.239075 Jun 17 08:36:52.663300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:52 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:52.836126 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:52.836797 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:52.842733 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.843262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.843925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:52.844360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:52.873888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:53.017845 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:53.025613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-046dcb56-30aa-4b80-b44c-e3f78339a62a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.193193 Jun 17 08:36:53.033568 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:52 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:53.300817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-b696854c-1d28-450d-9484-aa3502fa31f3 req-f05701c7-2c6e-4969-a085-de66aac4693c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670345b8-567e-4ba2-b484-d6b1dd74b8e7", "name": "network-vif-plugged", "status": "completed", "tag": "8e23daa6-602c-488f-98a6-1fafaeaa3860"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:36:53.309648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b696854c-1d28-450d-9484-aa3502fa31f3 req-f05701c7-2c6e-4969-a085-de66aac4693c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:53.310085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b696854c-1d28-450d-9484-aa3502fa31f3 req-f05701c7-2c6e-4969-a085-de66aac4693c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:53.320930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-b696854c-1d28-450d-9484-aa3502fa31f3 req-f05701c7-2c6e-4969-a085-de66aac4693c service nova] Creating event network-vif-plugged:8e23daa6-602c-488f-98a6-1fafaeaa3860 for instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 on hv-cinder-80377 Jun 17 08:36:53.330590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-b696854c-1d28-450d-9484-aa3502fa31f3 req-f05701c7-2c6e-4969-a085-de66aac4693c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Jun 17 08:36:53.330590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 100/200] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:36:53.670144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:53.670755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:53.676842 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:53.677410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:53.678228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:53.678663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:53.680219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:53.681040 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:53.687371 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:53.690811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:53.690811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:53.690811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:53.901739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:53.911819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:53.918249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1aad92c3-a193-4bbc-85aa-e05b41ffcf60 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.252192 Jun 17 08:36:53.920127 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:53 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:53.924182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d430db13-6d39-4fef-9fd5-319fccf73669 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.248647 Jun 17 08:36:53.924795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 101/202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:53 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:54.045624 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:54.046154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:54.052270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.052751 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:54.053752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.054275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:54.193414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:54.202566 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f3555e40-018d-4e9c-93f2-5c89b7fd4786 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.160941 Jun 17 08:36:54.203128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:54 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:54.946860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:54.946860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:54.947532 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:54.947532 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:54.953065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.953237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.953677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:54.953857 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:54.954695 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.955292 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:54.955696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:54.956142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:55.188037 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:55.189989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:55.198057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-db364174-3c6d-4a1c-b955-2106046fc809 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.257258 Jun 17 08:36:55.198736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:54 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:55.199098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-37ea34cf-6dac-43c4-93b1-3c8cdf3579ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.260923 Jun 17 08:36:55.199663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 102/205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:54 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:55.224410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:55.225847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:55.233576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:55.234277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:55.235062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:55.235635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:55.382597 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:55.389945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-18479a75-a91b-4be3-836e-ed50374b3164 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.169555 Jun 17 08:36:55.390500 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 104/206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:55 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:56.216345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:56.217816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:56.219517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:56.220128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:56.224676 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.225628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.226404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.226899 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.227467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.227912 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.229151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.229151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.480054 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:56.488004 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-190907f2-0da8-4f36-a55f-1e7b49cc1299 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.272261 Jun 17 08:36:56.488630 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 105/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:56 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:56.493364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:56.494174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:56.494330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:56.501164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.501619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.502388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:56.502996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:56.505777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-61701738-2f21-40aa-a58b-cb210e6e6a04 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.293147 Jun 17 08:36:56.514509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 103/208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:56 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:56.649895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:56.657387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-58bd830f-c2ad-45b8-b0f7-4e3c9ab64db3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.167824 Jun 17 08:36:56.657947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 106/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:56 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:57.506695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:57.507429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:57.513520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.513968 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.514726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.515162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.530371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:57.531810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:57.540607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.540909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.541685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.542127 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.731726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:57.735568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:57.741746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-73e5e40c-fd87-48eb-af95-5810e8ae5a3f tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.215276 Jun 17 08:36:57.747528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5602152c-e38e-4327-98be-ab5af6c4f7eb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.245448 Jun 17 08:36:57.748428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 104/210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:57 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:57.751486 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 107/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:57 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:36:57.761116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:57.761116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:57.762704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.763155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.763926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:57.764361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:57.901292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:57.908655 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d95c50a2-6a2f-48d2-bc94-fa77241bb9a9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.159059 Jun 17 08:36:57.909230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 105/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:57 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:58.761267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:58.762398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:58.765061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:58.765668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:58.769927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:58.770375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:58.771146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:58.771581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:58.772170 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:58.772675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:58.773440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:58.774033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:58.987889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:58.992240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:58.996055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b2aaa270-ed5f-40ea-bfbd-bd1794206d16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1314 microversion: 2.1 time: 0.241462 Jun 17 08:36:58.996849 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 108/213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:58 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:59.001303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:36:59.001708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-784cae63-a475-43b3-871b-5f170a5096a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.240545 Jun 17 08:36:59.001983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:36:59.002494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 106/214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:58 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:36:59.008280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:59.008894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:59.009829 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:36:59.010263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:36:59.162999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:36:59.171669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ed286380-d3a4-40f4-a573-ca967cad02e1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1363 microversion: 2.1 time: 0.173826 Jun 17 08:36:59.172263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 109/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:36:58 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:00.013149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:00.013768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:00.019453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:00.020307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:00.021308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.022101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.023278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.023924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.027288 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.027746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.030595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.031499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.271130 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:00.273591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:00.279318 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6864b0cd-4d32-45c8-9be5-bdab589ea68b tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1500 microversion: 2.1 time: 0.270100 Jun 17 08:37:00.281056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 107/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:00 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:00.288584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:00.289338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:00.290547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-934ff880-b805-4ed4-9954-7bdac62e04cb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.275121 Jun 17 08:37:00.293622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 110/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:00 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:00.296285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.296763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.297540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.297976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.446804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:00.454399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2323f75c-eab3-42e7-ad0d-b0e5e8daf1b4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1549 microversion: 2.1 time: 0.172256 Jun 17 08:37:00.454957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 108/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:00 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:00.471995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:00.472509 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:00.479194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.479646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.480413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:00.480876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:00.600972 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c06277c5-c27d-4c96-b87b-e8cbcb9e1224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132609 Jun 17 08:37:00.601580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:37:00 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:37:01.310009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:01.311922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:01.320778 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:01.321507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:01.322574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:01.323196 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:01.592724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:01.600134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3b882bbf-447b-481a-82bc-c90ecde33bcd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.294233 Jun 17 08:37:01.600734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 109/220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:01 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:02.165965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-5f89cedf-70ff-468c-9f91-e14671fc3208 req-a44403e1-760a-46bc-be0f-b82ff80c63f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d680267-4032-4899-9999-bd8fe751264c", "tag": "8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:37:02.176302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-5f89cedf-70ff-468c-9f91-e14671fc3208 req-a44403e1-760a-46bc-be0f-b82ff80c63f3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:02.176302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-5f89cedf-70ff-468c-9f91-e14671fc3208 req-a44403e1-760a-46bc-be0f-b82ff80c63f3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:02.188380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-5f89cedf-70ff-468c-9f91-e14671fc3208 req-a44403e1-760a-46bc-be0f-b82ff80c63f3 service nova] Creating event network-changed:8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b for instance 6d680267-4032-4899-9999-bd8fe751264c on hv-cinder-80377 Jun 17 08:37:02.193665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-5f89cedf-70ff-468c-9f91-e14671fc3208 req-a44403e1-760a-46bc-be0f-b82ff80c63f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031928 Jun 17 08:37:02.197178 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 112/221] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:37:02.622197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:02.623347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:02.629476 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:02.629924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:02.630734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:02.631831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:02.768245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:02.777294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3669d055-16db-4d04-8fd0-4f24541901c5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1322 microversion: 2.1 time: 0.158860 Jun 17 08:37:02.787677 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 110/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:02 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:02.945164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e289b52d-975c-4fb6-b7bc-805fda7aa7f3"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:37:02.946492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:02.953332 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:02.954276 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:02.956844 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:02.957498 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:03.794003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:03.794584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:03.800601 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:03.801057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:03.801926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:03.802364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:03.936777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:03.944466 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-158aeb3b-cee3-471a-be96-baa1add944a1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1516 microversion: 2.1 time: 0.154330 Jun 17 08:37:03.945056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:03 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:03.961386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:37:03.962386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:03.968391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:03.968866 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:03.969613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:03.970038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:04.041825 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'flavor' on Instance uuid 670345b8-567e-4ba2-b484-d6b1dd74b8e7 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:37:04.165964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d189bcf3-6494-426f-b170-7fc81d812d62 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "POST /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.224312 Jun 17 08:37:04.166589 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 113/224] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:37:02 2022] POST /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:37:04.427052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1f67b94e-b97d-47ca-a34e-fc87ae2e85ed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7/action" status: 200 len: 32 microversion: 2.1 time: 0.469888 Jun 17 08:37:04.428050 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 112/225] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:37:03 2022] POST /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7/action => generated 32 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 08:37:04.437864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:04.438564 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:04.446021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:04.446472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:04.452804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:04.452804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:04.587660 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:04.595393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-74a06cb7-51ee-4773-8438-13d7a3ff702b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.161735 Jun 17 08:37:04.595988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:04 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:05.612845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:05.613560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:05.620384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:05.620885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:05.621654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:05.622090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:05.639823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:05.754236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:05.761591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-63bb2b66-6aab-4f4e-9842-36eae3385ad0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.153290 Jun 17 08:37:05.762153 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:05 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:06.778517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:06.779128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:06.785715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:06.786164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:06.788029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:06.788514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:06.918010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:06.925381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-edac5c92-c408-4cc8-a712-755f5667564b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.150823 Jun 17 08:37:06.925948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 115/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:06 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:07.942942 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:07.944175 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:07.950602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:07.951052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:07.951823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:07.952260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:08.080935 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:08.088759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0c000e89-339b-4946-9590-8a9bb8f2e121 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.149658 Jun 17 08:37:08.089323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:07 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:09.105716 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:09.106335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:09.113339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:09.113790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:09.114569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:09.115013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:09.250880 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:09.254794 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:09.259796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-534769cf-fb11-4b91-ae39-60d46e290ff0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.157927 Jun 17 08:37:09.260375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 116/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:09 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:10.276970 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:10.281617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:10.284308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:10.284779 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:10.285537 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:10.285970 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:10.415759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:10.423210 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7cf1ed8a-99a4-4206-b15f-9af69655f203 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.149991 Jun 17 08:37:10.423761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:10 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:11.441024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:11.441653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:11.448743 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:11.449176 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:11.449944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:11.450380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:11.585892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:11.593136 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-dd3a0b22-1239-4a22-ace6-8997db6e6803 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.156398 Jun 17 08:37:11.593703 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:11 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:12.611471 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:12.631226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:12.631226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:12.631226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:12.631226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:12.631594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:12.757538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:12.764989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3b37b5d9-863e-4d89-8776-a13baacd8a8d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.158745 Jun 17 08:37:12.765579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:12 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:13.782505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:13.783033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:13.790020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:13.790459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:13.791207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:13.791635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:13.922717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:13.931012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ad2a4571-1338-4a15-8ba6-f465a4df69cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.152682 Jun 17 08:37:13.931934 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:13 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:14.948381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:14.949011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:14.955147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:14.955645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:14.956505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:14.957045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:15.098173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:15.106011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d512eddd-bcf2-4a97-8a04-84ec02160c3f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.161400 Jun 17 08:37:15.106580 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 117/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:14 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:16.123097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:16.123709 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:16.130983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:16.131433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:16.132208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:16.132842 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:16.284534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:16.293528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-854f4bc3-60f0-404f-8ee0-181d7a0db781 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.174292 Jun 17 08:37:16.294362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 119/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:16 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:17.314290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:17.314947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:17.321090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:17.321541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:17.322344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:17.322865 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:17.460511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:17.468038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-07499f78-1110-43da-8106-47197e530eeb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.157814 Jun 17 08:37:17.468669 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 118/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:17 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:18.492318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:18.492763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:18.506711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:18.508157 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:18.509067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:18.509807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:18.778696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:18.785804 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3a14b6c6-b611-4e91-8e1c-38f4cada12b5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.299992 Jun 17 08:37:18.786457 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:18 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:19.803279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:19.803279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:19.805282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=52 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:19.810349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:19.810863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:19.811801 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:19.812305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:20.010749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:20.019016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ec25af96-dd64-4639-9dc1-218613689557 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.220326 Jun 17 08:37:20.019802 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 119/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:19 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:21.035469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:21.036169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:21.038733 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=52 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:21.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:21.043881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:21.044684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:21.045119 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:21.174470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:21.182362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3ff5fd68-4b05-4124-a3e9-80d951ea704e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.150701 Jun 17 08:37:21.182938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 121/240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:21 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:22.201017 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:22.202270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:22.218688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:22.219136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:22.219918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:22.220344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:22.365301 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:22.372765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a8532b43-38f5-4306-ace2-029bdc36cb8a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.177340 Jun 17 08:37:22.373334 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 120/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:22 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:23.390249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:23.390861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:23.398075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:23.398529 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:23.399303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:23.399743 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:23.534277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:23.542005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-18696aca-92bf-4bbe-88c5-b71edbbdede9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.155903 Jun 17 08:37:23.542567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 122/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:23 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:24.095220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:24.096285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:24.103456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.104094 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.105065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.105657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.139297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:37:24.559075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:24.559692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:24.566358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.566809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.567837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.568405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.622630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b9a86282-0e4f-4ba0-8395-d5a3fe4ba5a5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 204 len: 0 microversion: 2.1 time: 0.530785 Jun 17 08:37:24.624173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 121/243] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:37:24 2022] DELETE /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:37:24.636985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:24.639025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:24.649686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.650225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.651039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:24.651476 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:24.951486 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:24.959681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ca9a719e-7bcc-43f3-8ff6-2adebb91effe tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.404339 Jun 17 08:37:24.960790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 123/244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:24 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:24.998249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:25.007383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-73c67563-e7ca-4a12-a577-37964cfccb41 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1552 microversion: 2.1 time: 0.378934 Jun 17 08:37:25.007951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:24 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1552 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:25.977406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:25.978023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:25.984726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:25.989393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:25.989393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:25.989393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:26.025081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:26.025686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:26.031609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:26.032047 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:26.032856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:26.033287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:26.168456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:26.179370 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8257d6c0-deff-4aad-8042-9dcfbe5552d2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.206261 Jun 17 08:37:26.180885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 124/246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:25 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:26.209741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:26.218738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3f2bc4b8-3316-4c4c-88ed-c43b9f2fb6db tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1552 microversion: 2.1 time: 0.197728 Jun 17 08:37:26.228773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:26 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:27.199285 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:27.199970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:27.213077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:27.213807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:27.221807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:27.221807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:27.238100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:27.238805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:27.252049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:27.252049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:27.252799 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:27.253245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:27.436278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:27.443966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6609df6f-6165-4af4-8605-a399adac1711 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.248321 Jun 17 08:37:27.453182 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 125/248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:27 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:27.473914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:27.484197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-12919ed4-af21-487b-b920-09ca04c45024 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1552 microversion: 2.1 time: 0.252901 Jun 17 08:37:27.494194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 124/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:27 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:28.231624 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-70dc17b0-d36e-424d-a2d3-60c5b7257acb req-0b059590-a34d-4836-add1-b64b31508678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a6815c-86aa-4533-a45a-cb9f491842ec", "name": "network-vif-deleted", "tag": "11e3e54d-60cb-4de4-854e-6011b75171a7"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:37:28.244864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-70dc17b0-d36e-424d-a2d3-60c5b7257acb req-0b059590-a34d-4836-add1-b64b31508678 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:28.248961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-70dc17b0-d36e-424d-a2d3-60c5b7257acb req-0b059590-a34d-4836-add1-b64b31508678 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:28.261568 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-70dc17b0-d36e-424d-a2d3-60c5b7257acb req-0b059590-a34d-4836-add1-b64b31508678 service nova] Creating event network-vif-deleted:11e3e54d-60cb-4de4-854e-6011b75171a7 for instance 57a6815c-86aa-4533-a45a-cb9f491842ec on hv-cinder-80377 Jun 17 08:37:28.270333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-70dc17b0-d36e-424d-a2d3-60c5b7257acb req-0b059590-a34d-4836-add1-b64b31508678 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043778 Jun 17 08:37:28.272045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 126/250] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:37:28.461766 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:28.462308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:28.469668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:28.470120 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:28.470917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:28.471348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:28.503307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:28.504022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:28.510662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:28.511117 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:28.511925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:28.512360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:28.581994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:28.591415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2ad4cb6b-0cdf-42cc-9c8d-347a54515e16 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1345 microversion: 2.1 time: 0.093604 Jun 17 08:37:28.592283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 127/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:28 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:28.647690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:28.655426 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5c87dd5b-09f2-4e1a-a62b-aa5ae164d619 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.199009 Jun 17 08:37:28.656029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 125/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:28 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:29.608183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:29.616335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:29.616335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:29.616335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:29.616732 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:29.617167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:29.650779 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:29.651213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:29.651815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lazy-loading 'fault' on Instance uuid 57a6815c-86aa-4533-a45a-cb9f491842ec {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:37:29.675375 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:29.675375 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:29.681694 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:29.682397 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:29.683239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:29.683874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:29.700332 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cef287aa974448b3abef26a8018f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8166c0f90124dac9d758720686535e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:29.734995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ac0114e1-637d-48c5-8c80-cb1cd09ffacd tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 200 len: 1350 microversion: 2.1 time: 0.130330 Jun 17 08:37:29.745122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 128/253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:29 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:30.034925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:30.042420 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5ad48869-672d-4264-bd6c-16de7ab9d2af tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.374271 Jun 17 08:37:30.042978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:29 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:30.755123 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:30.756027 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:30.765245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:30.766286 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:30.766484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:30.766931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:30.780736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] HTTP exception thrown: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Request method failure captured: Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec HTTP/1.1 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzhq18tkjCeFkuP_iXOCd-s7Bc27SKg2yNgGokZDhwo9HwTeZBlV-oYuonStIWNaqcpF_XRu8E_cNpK6rt_NUCsnDQpJJi6Y_jG5Qr7Efnr3ny8LFlNLG4ZW8TboIYUUUezxMZGrDcW23UkXBcFpq2JvphWSW-e8mSdytwnpSA8iuQ Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:37:30.792088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8166c0f90124dac9d758720686535e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8166c0f90124dac9d758720686535e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: a9cef287aa974448b3abef26a8018f03 Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:30.793358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '57a6815c-86aa-4533-a45a-cb9f491842ec'} Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:37:30.794041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:30.795362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:30.796579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Returning 404 to user: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:37:30.796579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-af7c4a94-9f70-42e8-9cca-d0bece9ceea5 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 404 len: 111 microversion: 2.1 time: 0.044766 Jun 17 08:37:30.797686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:30 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:37:31.060391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:31.061061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:31.067125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:31.069404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:31.069404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:31.069709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:31.088876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:31.089991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:31.098144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:31.098144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:31.098144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:31.098144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:31.123522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] HTTP exception thrown: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Request method failure captured: Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec/os-volume_attachments HTTP/1.1 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzhq18tkjCeFkuP_iXOCd-s7Bc27SKg2yNgGokZDhwo9HwTeZBlV-oYuonStIWNaqcpF_XRu8E_cNpK6rt_NUCsnDQpJJi6Y_jG5Qr7Efnr3ny8LFlNLG4ZW8TboIYUUUezxMZGrDcW23UkXBcFpq2JvphWSW-e8mSdytwnpSA8iuQ Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:37:31.125339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8166c0f90124dac9d758720686535e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8166c0f90124dac9d758720686535e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: a9cef287aa974448b3abef26a8018f03 Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:31.127896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'server_id': '57a6815c-86aa-4533-a45a-cb9f491842ec'} Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:37:31.128714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:31.129763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:31.131135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Returning 404 to user: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:37:31.131135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-435a1425-4ea0-44cb-ba02-8f524ef35850 tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042704 Jun 17 08:37:31.131135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 130/256] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:37:31 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:37:31.210403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:31.217937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e2e495cb-8c84-4841-bcdc-b1784cb2b0b1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.161625 Jun 17 08:37:31.218492 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 127/257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:31 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:32.235165 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:32.235950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:32.243600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:32.244048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:32.244852 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:32.251001 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:32.387163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:32.394599 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6af146dc-b3a3-4059-9cfe-425cc448b0bd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.163395 Jun 17 08:37:32.395157 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 131/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:32 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:33.412730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:33.414220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:33.421687 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.422131 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.422895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.423329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.441954 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:33.579304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:33.587609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-90a171d7-d62c-4fa3-a365-006745953bf5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.179619 Jun 17 08:37:33.593042 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 128/259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:33 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:33.739602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:33.740105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:33.747030 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.747474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.748238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.748708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.763052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] HTTP exception thrown: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Request method failure captured: Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec HTTP/1.1 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzhq18tkjCeFkuP_iXOCd-s7Bc27SKg2yNgGokZDhwo9HwTeZBlV-oYuonStIWNaqcpF_XRu8E_cNpK6rt_NUCsnDQpJJi6Y_jG5Qr7Efnr3ny8LFlNLG4ZW8TboIYUUUezxMZGrDcW23UkXBcFpq2JvphWSW-e8mSdytwnpSA8iuQ Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:37:33.764781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8166c0f90124dac9d758720686535e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8166c0f90124dac9d758720686535e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: a9cef287aa974448b3abef26a8018f03 Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.766139 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '57a6815c-86aa-4533-a45a-cb9f491842ec'} Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:37:33.766917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.768185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.770209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Returning 404 to user: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:37:33.771131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0a4bfc50-9eda-45d3-bf54-50dca633e73d tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 404 len: 111 microversion: 2.1 time: 0.035697 Jun 17 08:37:33.771680 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 132/260] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:37:33 2022] DELETE /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:37:33.789194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:33.789194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] [instance: 57a6815c-86aa-4533-a45a-cb9f491842ec] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:33.789194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.789194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.789467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:33.789467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:33.827367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] HTTP exception thrown: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Request method failure captured: Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec HTTP/1.1 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzhq18tkjCeFkuP_iXOCd-s7Bc27SKg2yNgGokZDhwo9HwTeZBlV-oYuonStIWNaqcpF_XRu8E_cNpK6rt_NUCsnDQpJJi6Y_jG5Qr7Efnr3ny8LFlNLG4ZW8TboIYUUUezxMZGrDcW23UkXBcFpq2JvphWSW-e8mSdytwnpSA8iuQ Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:37:33.832160 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8166c0f90124dac9d758720686535e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8166c0f90124dac9d758720686535e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8166c0f90124dac9d758720686535e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: c8166c0f90124dac9d758720686535e9 Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377744493 Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: a9cef287aa974448b3abef26a8018f03 Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-DeleteServersTestJSON-1377744493-project Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.833561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '57a6815c-86aa-4533-a45a-cb9f491842ec'} Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:37:33.834330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. Jun 17 08:37:33.836026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:37:33.838489 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] Returning 404 to user: Instance 57a6815c-86aa-4533-a45a-cb9f491842ec could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:37:33.839429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5e6f729e-1378-4c3a-8a98-3adf45734d9c tempest-DeleteServersTestJSON-1377744493 tempest-DeleteServersTestJSON-1377744493-project] 10.222.0.48 "GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec" status: 404 len: 111 microversion: 2.1 time: 0.063630 Jun 17 08:37:33.842290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 129/261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:33 2022] GET /compute/v2.1/servers/57a6815c-86aa-4533-a45a-cb9f491842ec => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:37:34.604556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:34.605239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:34.611725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:34.612237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:34.613035 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:34.613473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:34.849364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:34.861426 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-98899e01-f59c-4c54-a41d-52783edf8bcf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.260554 Jun 17 08:37:34.866828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 133/262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:34 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:35.878287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:35.878900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:35.899039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:35.899672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:35.901339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:35.907431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:36.113393 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:36.126768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d919ac95-4d58-4161-9af8-94c645f4e630 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.252309 Jun 17 08:37:36.127740 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 130/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:35 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:37.145581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:37.146789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:37.164396 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:37.165199 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:37.165989 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:37.166447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:37.372009 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:37.378847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aebf9a06-d898-4d40-b500-017a570c8480 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.237173 Jun 17 08:37:37.379840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 134/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:37 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:38.407585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:38.408201 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:38.433729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:38.435189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:38.438342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:38.439993 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:38.595355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:38.611186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a44d1bf3-c641-428c-a0e8-545a9321cc99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.218027 Jun 17 08:37:38.612962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 131/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:38 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:39.630472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:39.631814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:39.641122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:39.641535 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:39.642313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:39.642756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:39.790095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:39.794483 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:39.798811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-898e4bfb-4aaa-4098-b680-088a72059874 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.173628 Jun 17 08:37:39.799373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 135/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:39 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:40.819456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:40.821879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:40.831077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:40.831993 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:40.833112 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:40.833758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:41.020085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:41.028751 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e10fe0ff-d8f7-4633-975e-2ae6e013bdea tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.217448 Jun 17 08:37:41.029538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 132/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:40 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:42.047397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:42.048461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:42.078020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:42.078020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:42.078020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:42.078020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:42.205654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:42.213507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4b8d42e7-1618-4e12-a21c-e9f2fbb3a2e0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1522 microversion: 2.1 time: 0.171332 Jun 17 08:37:42.214085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 136/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:42 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:43.231411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:43.232022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:43.238384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:43.238827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:43.239585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:43.240012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:43.425357 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:43.454410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bbfb3959-39f9-4145-83a4-915fc697c8f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1502 microversion: 2.1 time: 0.227716 Jun 17 08:37:43.455470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 133/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:43 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:43.471807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:43.472425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:43.479043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:43.479502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:43.480389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:43.480739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:43.660813 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:43.670108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a67229be-fe9f-46dc-b02b-10c6ee154dc4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1515 microversion: 2.1 time: 0.202352 Jun 17 08:37:43.670719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 137/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:43 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:47.392398 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:37:47.393389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:47.404060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:47.406098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:47.408046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:47.415353 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:47.440974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'flavor' on Instance uuid 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:37:47.842393 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4e3a6b19-70ee-4407-9f75-456bde2f7093 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/action" status: 200 len: 32 microversion: 2.1 time: 0.453512 Jun 17 08:37:47.843633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 134/271] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:37:47 2022] POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:37:47.857106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:47.858424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:47.876527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:47.876527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:47.876527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:47.876527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:48.076381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:48.085616 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-772b4145-baf5-4a3c-b6d6-975e4b17a12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.236978 Jun 17 08:37:48.086192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:47 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:49.110100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:49.110920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:49.117953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:49.118436 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:49.119248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:49.119685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:49.276196 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:49.284587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-96098a65-bbc3-4a71-b675-5173aa4da060 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.178699 Jun 17 08:37:49.285303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:49 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:50.302104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:50.302723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:50.310320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:50.311061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:50.311937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:50.312405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:50.457440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:50.467014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fedbc8bb-30bd-463a-9c1e-527d9414c7e9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.168821 Jun 17 08:37:50.467596 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 139/274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:50 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:51.485224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:51.485862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:51.492551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:51.493189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:51.494037 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:51.494781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:51.760749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:51.769322 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d2713032-b5fb-46c5-a211-230c168be56d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.288175 Jun 17 08:37:51.769936 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 136/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:51 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:52.800211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:52.800888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:52.808079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:52.813314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:52.817336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:52.817336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:53.078039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:53.086784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2e6a2900-9dda-4cfa-a000-ca683524b1b9 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.290375 Jun 17 08:37:53.090712 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:52 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:54.108239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:54.109874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:54.113150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:54.117616 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:54.118068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:54.118843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:54.119892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:54.306177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:54.314938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-248fb1d6-0eec-4b01-b936-d6960e45df25 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.210711 Jun 17 08:37:54.326966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 137/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:54 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:37:55.334165 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:55.336089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:55.350534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=42 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:55.353421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:55.355053 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:55.356218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:55.357379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:55.663159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:55.675962 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d73fc7bd-b632-4cce-a063-7af160fa01ce tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.346332 Jun 17 08:37:55.684559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 141/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:55 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:56.709547 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:56.711910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:56.724696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:56.728022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:56.730961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:56.731853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:57.003561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:57.013213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-eefdee1d-a985-4051-883f-2891ac92c7cf tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.316547 Jun 17 08:37:57.013924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 138/279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:56 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:58.031681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:58.032578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:58.040723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:58.041193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:58.042999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:58.044143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:58.226679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:58.243384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b25cce51-1279-40b6-af4d-0008f5c73eb7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.215714 Jun 17 08:37:58.246542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 142/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:58 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:37:59.267315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:37:59.268842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:37:59.275922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:59.281930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:59.283218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:37:59.283698 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:37:59.507069 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:37:59.518490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4663f593-a5ee-4eeb-ba60-aa00d5e5525a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.258316 Jun 17 08:37:59.523368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 139/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:37:59 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:00.536786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:00.537485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:00.546860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:00.547499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:00.548562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:00.549149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:01.072258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:01.092203 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6dad764e-87f7-4ecf-9920-6d6bbad09387 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.558134 Jun 17 08:38:01.093491 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 143/282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:00 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:02.112115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:02.112928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:02.124863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:02.125567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:02.126608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:02.127200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:02.404846 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:02.416832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b5eb77f-8ac7-4da7-9fdc-99c78e12bf07 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.309654 Jun 17 08:38:02.417895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 140/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:02 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:03.446916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:03.449486 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:03.459306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.460072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:03.461161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.462001 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:03.640524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:03.657616 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c278d2df-0808-42d2-a398-5387ae0bb4fc tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1501 microversion: 2.1 time: 0.225718 Jun 17 08:38:03.658338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 144/284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:03 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:03.675920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d93ece-ee41-4e26-85a6-50917f679499"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:03.677904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:03.684389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.684952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:03.685977 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.686621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:03.715702 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] HTTP exception thrown: Cannot 'attach_volume' instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 while it is in vm_state rescued Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Request method failure captured: Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/os-volume_attachments HTTP/1.1 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 74 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzkat9T4Cius2sftjM6S0vQhUcYbQphNwFQyaVGljL-n4LZeQQFxun03Oa_Bl3EGfeVjdnjbCa0XnSmpEvtSkzxiGSw8YodBzSxeNbFyWC-E7-L3RfpZPk_grbTBaUXJdJP15aHRPUo6rLiiHB_shDjrtfgfdobrtlc5tkSKmoGR30 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:38:03.718107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fb1df28c175c40b7a06d1f94ba780d28 Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {"volumeAttachment": {"volumeId": "41d93ece-ee41-4e26-85a6-50917f679499"}} Jun 17 08:38:03.719678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Cannot 'attach_volume' instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 while it is in vm_state rescued Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'server_id': '8717f6aa-b085-47bb-b1cf-2d52ba7a84c8', 'body': {'volumeAttachment': {'volumeId': '41d93ece-ee41-4e26-85a6-50917f679499'}}} Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:38:03.720531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 while it is in vm_state rescued Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:38:03.743090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 while it is in vm_state rescued Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Returning 409 to user: Cannot 'attach_volume' instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 while it is in vm_state rescued {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75219b0b-3dfc-46c5-899c-7a1021e6c83b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050642 Jun 17 08:38:03.744632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 141/285] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:38:03 2022] POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 08:38:03.751277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:03.751938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:03.759054 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.759591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:03.760516 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:03.760958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:04.101569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f94588f0-ad8b-402e-a2ea-f8d96d8ebb84 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/action" status: 202 len: 0 microversion: 2.1 time: 0.355843 Jun 17 08:38:04.102287 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 145/286] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:38:03 2022] POST /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:38:04.112073 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:04.113407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:04.120556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:04.121336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:04.122114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:04.122703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:04.359688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:04.377810 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f72dacb6-b844-4fc9-b5c9-40be89f30a9b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1509 microversion: 2.1 time: 0.262765 Jun 17 08:38:04.392053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 142/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:04 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:38:05.413439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:05.416900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:05.430619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:05.431076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:05.431961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:05.432272 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:05.606445 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:05.614040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9fe34eb5-d7bc-400f-8ff3-185e5e7766a5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1509 microversion: 2.1 time: 0.208609 Jun 17 08:38:05.614607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 146/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:05 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:06.631784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:06.633158 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:06.640804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:06.641408 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:06.642387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:06.646354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:06.839109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:06.850303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ae4264d0-eb40-4a40-aa89-e754f237859c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1509 microversion: 2.1 time: 0.222464 Jun 17 08:38:06.851581 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 143/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:06 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:07.436837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bbcef463-d98b-43cd-aac3-43da00763127 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Action: 'create', calling method: .version_select at 0x7ff0254a58b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2085413800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSwZd2WULtOvZF0MsHbG9ITVkhujK55MevWvNDwVsqWtTwqw6QpiUXXnPXO5sYBxpxiL7hqDDNPRx0KDPzRx8U0jw47mAbCIcYzFYzB9uqtu3sDENtPm80JPDeEQe3USg=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:07.451756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-bbcef463-d98b-43cd-aac3-43da00763127 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:38:07.455919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-bbcef463-d98b-43cd-aac3-43da00763127 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for user 94d49cbc2d5d458881d3c2a5880f9109 and project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:38:07.620620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bbcef463-d98b-43cd-aac3-43da00763127 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.368938 Jun 17 08:38:07.622237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 147/290] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:38:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:38:07.869333 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:07.869966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:07.877107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:07.877554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:07.878315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:07.878755 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:07.882997 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:08.039792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:08.052415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7959a708-ff7c-4ce4-8163-ee57cdf9c12e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1509 microversion: 2.1 time: 0.187369 Jun 17 08:38:08.054326 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 144/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:07 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:09.078603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:09.079160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:09.094027 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:09.094481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:09.095283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:09.095719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:09.328778 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:09.339449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9cb8dace-88b1-4fb3-a798-18de67588466 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1515 microversion: 2.1 time: 0.271098 Jun 17 08:38:09.344605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 148/292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:09 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:12.447076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-280138d8-0609-418e-a6ea-ee931de27b94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: .version_select at 0x7ff025e03d30>, body: {"keypair": {"name": "tempest-keypair-1354485464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJaHhBpkSAFntNt3V+KDwBXVBYzZRehKNabgxIaUdnkXODxc7eWoBL1ZbqL8LTOAp3iNdP3uv/mCSA/GvizNE/6m+ldL3Zt0mDhxma2iLvkkRuIwrAxbkHQ9Ubz5CCEjQ=="}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:12.466727 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-280138d8-0609-418e-a6ea-ee931de27b94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for project ae365d6da0e846baa0056cb67ac716d6. Resources: {'key_pairs'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:38:12.470654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-280138d8-0609-418e-a6ea-ee931de27b94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for user fb1df28c175c40b7a06d1f94ba780d28 and project ae365d6da0e846baa0056cb67ac716d6. Resources: {'key_pairs'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:38:12.610316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-280138d8-0609-418e-a6ea-ee931de27b94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167017 Jun 17 08:38:12.610951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 145/293] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:38:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:38:15.996540 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2073799333", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c930e804-5e32-4961-9c29-6ba52f705297"}], "security_groups": [{"name": "tempest-securitygroup--1386891422"}], "key_name": "tempest-keypair-1354485464", "user_data": "}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:17.463290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:19.335610 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:26.006736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:27.364060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] validate_networks() for [('c930e804-5e32-4961-9c29-6ba52f705297', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:38:27.872036 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:38:27.872461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:38:27.873043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:38:27.873454 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:38:27.873869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:38:27.890069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:27.890069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:27.890069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:27.890069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:27.905310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:38:27.913303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Getting quotas for user fb1df28c175c40b7a06d1f94ba780d28 and project ae365d6da0e846baa0056cb67ac716d6. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:38:27.926932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:38:27.929327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:38:28.093739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8ca7a39a-3f23-4c8c-a04b-045c3e2efcc3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.101725 Jun 17 08:38:28.094981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 149/294] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:38:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 12104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:38:28.101863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=4 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:28.102635 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:28.106716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a0dd1713-3251-499c-b8b0-8df82f6663f0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:28.107329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a0dd1713-3251-499c-b8b0-8df82f6663f0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:28.165568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a0dd1713-3251-499c-b8b0-8df82f6663f0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:28.176445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a0dd1713-3251-499c-b8b0-8df82f6663f0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1246 microversion: 2.1 time: 0.075094 Jun 17 08:38:28.177295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 146/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:28 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:29.194769 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:29.195379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:29.202239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:29.203203 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:29.203978 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:29.204466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:29.303840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:29.313585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-dad90528-4b36-416d-a2ef-8351a0eff4fd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1250 microversion: 2.1 time: 0.123283 Jun 17 08:38:29.315496 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 150/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:29 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1250 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:38:30.336583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:30.339290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:30.363910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:30.364667 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:30.371306 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:30.371306 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:30.451981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:30.467859 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-22d4b286-b4c2-43ee-ada0-df8e7acfa6a4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1298 microversion: 2.1 time: 0.139028 Jun 17 08:38:30.468428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 147/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:30 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:31.486382 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:31.487540 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:31.499230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:31.500061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:31.501407 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:31.503143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:31.829920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:31.848153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-49db0db6-7a41-446c-9b5c-bb78718c23fa tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1304 microversion: 2.1 time: 0.366517 Jun 17 08:38:31.848990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:31 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1304 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:32.867709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:32.869260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:32.880715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:32.880715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:32.880715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:32.880715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:33.032561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:33.051310 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-043a16d4-9d68-4494-a64c-aac0cd8fbf4c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.181276 Jun 17 08:38:33.051310 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 148/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:32 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:33.078010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-1f39e8c4-2956-4a4d-84e7-121522763e78 req-fc8b4dc2-98d5-43f3-88c4-bb2c0c93425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:33.093456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1f39e8c4-2956-4a4d-84e7-121522763e78 req-fc8b4dc2-98d5-43f3-88c4-bb2c0c93425c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:33.094186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1f39e8c4-2956-4a4d-84e7-121522763e78 req-fc8b4dc2-98d5-43f3-88c4-bb2c0c93425c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:33.110917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-1f39e8c4-2956-4a4d-84e7-121522763e78 req-fc8b4dc2-98d5-43f3-88c4-bb2c0c93425c service nova] Creating event network-changed:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:38:33.119072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-1f39e8c4-2956-4a4d-84e7-121522763e78 req-fc8b4dc2-98d5-43f3-88c4-bb2c0c93425c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047011 Jun 17 08:38:33.119888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 152/300] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:38:34.067860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:34.068651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:34.076297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:34.077136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:34.091002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:34.091002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:34.232656 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:34.242356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ec0d6339-7678-4ae8-bd18-b7b0098dca70 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.179026 Jun 17 08:38:34.242915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 149/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:34 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:35.259580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:35.260275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:35.266962 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:35.267333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:35.268665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:35.269103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:35.412266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:35.419629 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5017b1cc-69a5-4fad-8159-988d5c2319f6 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.164177 Jun 17 08:38:35.420181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 153/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:35 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:36.436390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:36.437035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:36.445678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:36.445678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:36.445678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:36.445678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:36.620317 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:36.628186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a65e75fc-ebbb-45bd-8bea-0bb4d3cd0479 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.195608 Jun 17 08:38:36.628809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 150/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:36 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:37.644728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:37.645363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:37.651764 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:37.652217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:37.653040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:37.653476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:37.794940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:37.803169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c3879de2-3383-4361-bada-0714343c9ec4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.162357 Jun 17 08:38:37.803731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 154/304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:37 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:38.819182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:38.819792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:38.826150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:38.826604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:38.827367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:38.827795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:38.975087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:38.982447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0fe6b4fc-8702-48fe-8135-6973cd16727a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.167169 Jun 17 08:38:38.983012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 151/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:38 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:39.999461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:40.000161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:40.002236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:40.003019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=6 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:40.008466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:40.009021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:40.009783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:40.010221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:40.144040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:40.149342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aa1691e9-7f2a-450b-89b8-5d1548ac7774 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.154105 Jun 17 08:38:40.149908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 155/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:39 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:41.166403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:41.168304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:41.170389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:41.175776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:41.176453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:41.177840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:41.178331 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:41.318288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:41.326972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a2540e85-30da-430a-ad1b-2419bf3f6ae0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.164677 Jun 17 08:38:41.327540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 152/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:41 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:42.343729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:42.344388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:42.351330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:42.351775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:42.352553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:42.352985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:42.480969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:42.488254 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-45a4db26-1dcf-4c26-a3e0-4a7ec5b0e67b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.148399 Jun 17 08:38:42.488830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 156/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:42 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:43.507168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:43.507779 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:43.514832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:43.515278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:43.516238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:43.516707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:43.648354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:43.655844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d95b2fb3-7494-4d51-9564-47132ccdc1a7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.153913 Jun 17 08:38:43.656476 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 153/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:43 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:44.674208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:44.674820 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:44.682366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:44.682828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:44.683600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:44.684033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:44.815996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:44.824085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0735db29-fc52-41f9-ab43-4fbff696e907 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.153752 Jun 17 08:38:44.824994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 157/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:44 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:45.845918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:45.847050 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:45.854124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:45.854608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:45.855708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:45.856163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:46.012732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:46.017636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cf3ef5f2-60a4-4a4f-b6c3-68369684c27f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.179193 Jun 17 08:38:46.018289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 154/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:45 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:46.423230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-812f674a-86fc-44a0-9283-772807a3a4ab req-82a638d3-8d37-49a1-b288-3e279ff3aa0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "name": "network-vif-plugged", "status": "completed", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:46.432411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-812f674a-86fc-44a0-9283-772807a3a4ab req-82a638d3-8d37-49a1-b288-3e279ff3aa0b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:46.432902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-812f674a-86fc-44a0-9283-772807a3a4ab req-82a638d3-8d37-49a1-b288-3e279ff3aa0b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:46.443449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-812f674a-86fc-44a0-9283-772807a3a4ab req-82a638d3-8d37-49a1-b288-3e279ff3aa0b service nova] Creating event network-vif-plugged:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:38:46.448586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-812f674a-86fc-44a0-9283-772807a3a4ab req-82a638d3-8d37-49a1-b288-3e279ff3aa0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029044 Jun 17 08:38:46.449157 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 158/312] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:38:47.036451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:47.038790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:47.048166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:47.056794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:47.056794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:47.056794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:47.205980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:47.214252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2f71063c-7946-4f34-9aa4-1f91e950b362 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.183182 Jun 17 08:38:47.214819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 155/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:47 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:48.232716 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:48.233409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:48.239897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:48.240454 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:48.241896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:48.242352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:48.378339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:48.386057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-acf038cb-eef4-48cf-a049-0dd6e1802fa4 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.158217 Jun 17 08:38:48.394270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 159/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:48 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:49.403444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:49.404060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:49.410814 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:49.411349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:49.412197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:49.412670 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:49.553147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:49.562149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a7072f63-eb1c-4c86-bb38-d21107fc4903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1372 microversion: 2.1 time: 0.162932 Jun 17 08:38:49.562734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 156/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:49 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:50.580645 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:50.581289 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:50.589080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:50.589522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:50.590290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:50.590723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:50.593465 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=55 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:50.810141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:50.817985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d35cd619-fac4-415f-b183-e0c64153325a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1566 microversion: 2.1 time: 0.241205 Jun 17 08:38:50.818544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 160/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:50 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:50.835186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:50.835783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:50.841728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:50.854900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:50.854900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:50.854900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:50.933283 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6a162314-d3c5-498a-9625-dffbdf02d274 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102181 Jun 17 08:38:50.933837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 157/317] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:38:50 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:38:52.388260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-005572e1-b0da-4fe2-8146-36b6b3c3b342 req-660e53b3-1c64-401a-bbb7-04c0c97642df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:52.394436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-005572e1-b0da-4fe2-8146-36b6b3c3b342 req-660e53b3-1c64-401a-bbb7-04c0c97642df service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:52.395306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-005572e1-b0da-4fe2-8146-36b6b3c3b342 req-660e53b3-1c64-401a-bbb7-04c0c97642df service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:52.408017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-005572e1-b0da-4fe2-8146-36b6b3c3b342 req-660e53b3-1c64-401a-bbb7-04c0c97642df service nova] Creating event network-changed:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:38:52.414098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-005572e1-b0da-4fe2-8146-36b6b3c3b342 req-660e53b3-1c64-401a-bbb7-04c0c97642df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Jun 17 08:38:52.415448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 161/318] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:38:56.623103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1714705074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085413800", "security_groups": [{"name": "tempest-secgroup-smoke-1006178609"}], "block_device_mapping_v2": [{"uuid": "bff8b7cb-2d07-4ebd-84bb-d562d7a55669", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24510b06-bea9-4fd6-97a7-6277343ccc18"}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:56.827349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] validate_networks() for [('24510b06-bea9-4fd6-97a7-6277343ccc18', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:38:57.236019 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:38:57.236449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:38:57.236953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:38:57.237361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:38:57.237772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:38:57.248818 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:57.249268 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:57.250066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:57.250509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:57.268565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:38:57.272680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for user 94d49cbc2d5d458881d3c2a5880f9109 and project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:38:57.333626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:38:57.335703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bff8b7cb-2d07-4ebd-84bb-d562d7a55669',volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:38:57.841075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [02359e58-f99c-4e08-b605-4cafa8cb801d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 08:38:58.848435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [02359e58-f99c-4e08-b605-4cafa8cb801d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 32894. Jun 17 08:38:58.854280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fc4ee97e-a38a-4902-8eb6-beb690e39c24 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.233809 Jun 17 08:38:58.859308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 158/319] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:38:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:38:58.870278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9817413c-ca3d-4cc0-a93e-b742533521b2 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:58.870996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9817413c-ca3d-4cc0-a93e-b742533521b2 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:58.872998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:38:58.933819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9817413c-ca3d-4cc0-a93e-b742533521b2 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:58.940744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9817413c-ca3d-4cc0-a93e-b742533521b2 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1095 microversion: 2.1 time: 0.080281 Jun 17 08:38:58.941317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 162/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:58 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:58.986662 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-934485059", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:38:59.037898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] validate_networks() for None {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:38:59.318138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:38:59.318561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:38:59.319038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:38:59.319444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:38:59.319851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:38:59.329067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:59.329516 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:59.334167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:38:59.334167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:38:59.348100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Getting quotas for project 0c50da3e76414a17a53e2a931b6bc715. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:38:59.351941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Getting quotas for user 3e83c8b08dba4ff0ae4a05395bd8f652 and project 0c50da3e76414a17a53e2a931b6bc715. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:38:59.363444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:38:59.365603 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:38:59.524217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e6be42c8-ec96-4158-aed2-e2bc5fed20b1 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541372 Jun 17 08:38:59.524934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 159/321] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:38:59.535711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e7b5f6ec-23ec-49a2-b4d4-c43bd0a89bfb tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:59.536328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e7b5f6ec-23ec-49a2-b4d4-c43bd0a89bfb tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:38:59.590352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e7b5f6ec-23ec-49a2-b4d4-c43bd0a89bfb tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:38:59.600131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e7b5f6ec-23ec-49a2-b4d4-c43bd0a89bfb tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1214 microversion: 2.1 time: 0.068521 Jun 17 08:38:59.600772 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 163/322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:59 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:38:59.958592 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-40846a06-9b82-4288-a894-ac55bcccb9dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:38:59.959201 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-40846a06-9b82-4288-a894-ac55bcccb9dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:00.020411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-40846a06-9b82-4288-a894-ac55bcccb9dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:00.028152 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-40846a06-9b82-4288-a894-ac55bcccb9dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1095 microversion: 2.1 time: 0.073467 Jun 17 08:39:00.028743 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 160/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:38:59 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:00.623370 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b4a1e20b-2c35-4219-a3c2-f1b7adfc8182 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:00.624542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b4a1e20b-2c35-4219-a3c2-f1b7adfc8182 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:00.687721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b4a1e20b-2c35-4219-a3c2-f1b7adfc8182 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:00.697781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b4a1e20b-2c35-4219-a3c2-f1b7adfc8182 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1214 microversion: 2.1 time: 0.078016 Jun 17 08:39:00.698388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 164/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:00 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:01.045606 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-df157f36-abe0-4c8a-8e59-796c60b1b8e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:01.046192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-df157f36-abe0-4c8a-8e59-796c60b1b8e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:01.047976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:01.099209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-df157f36-abe0-4c8a-8e59-796c60b1b8e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:01.106411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-df157f36-abe0-4c8a-8e59-796c60b1b8e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1095 microversion: 2.1 time: 0.064698 Jun 17 08:39:01.106975 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 161/325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:01 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:01.715262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-01faa227-6b49-430c-bb5c-0a0f4ef827ec tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:01.716057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-01faa227-6b49-430c-bb5c-0a0f4ef827ec tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:01.767967 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-01faa227-6b49-430c-bb5c-0a0f4ef827ec tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:01.774686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-01faa227-6b49-430c-bb5c-0a0f4ef827ec tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1214 microversion: 2.1 time: 0.064341 Jun 17 08:39:01.776473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 165/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:01 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:02.124233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:02.125204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:02.131931 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:02.132372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:02.133154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:02.133611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:02.137173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=73 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:02.199897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:02.208214 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-07d7af0c-4a29-4b26-b74f-d7086ae5f949 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1145 microversion: 2.1 time: 0.089143 Jun 17 08:39:02.208805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 162/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:02 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:02.793083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:02.793747 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:02.795605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=7 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:02.801132 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:02.801586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:02.802387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:02.802827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:02.869078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:02.876512 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-52b99f4c-b6da-4126-a9ad-540e1a1b4860 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1218 microversion: 2.1 time: 0.087835 Jun 17 08:39:02.877338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 166/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:02 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:03.224946 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:03.225599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:03.233716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:03.234168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:03.234940 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:03.235384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:03.304200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:03.314869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7f9b496d-b9f8-46dd-b89e-fa86579c539a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1137 microversion: 2.1 time: 0.093078 Jun 17 08:39:03.315457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 163/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:03 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:03.894389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:03.894998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:03.901827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:03.902829 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:03.903591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:03.904021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:03.966990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:03.974438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a0d1c4da-35f7-4b5f-8fe1-ec1b54542589 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1266 microversion: 2.1 time: 0.084334 Jun 17 08:39:03.975025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 167/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:03 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:04.332942 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:04.334102 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:04.341463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:04.342667 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:04.343739 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:04.344330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:04.448976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:04.458403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7c2aee6e-d049-4c57-b943-a8d8124505aa tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1201 microversion: 2.1 time: 0.129027 Jun 17 08:39:04.459571 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 164/331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:04 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1201 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:04.993469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:04.993992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:05.003339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:05.004117 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:05.004919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:05.005350 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:05.075990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:05.087602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9760d149-6b19-441b-bb26-1ffc91e4aade tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1272 microversion: 2.1 time: 0.095155 Jun 17 08:39:05.087602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 168/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:04 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:05.481004 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:05.481894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:05.492285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:05.492772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:05.493561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:05.494086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:05.696806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:05.726054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-03cb0239-5192-4128-b8c3-597c034174ed tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1279 microversion: 2.1 time: 0.252865 Jun 17 08:39:05.726637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 165/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:05 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:06.101980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:06.102643 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:06.115045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:06.115790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:06.116606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:06.117205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:06.339449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:06.347938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5fadaca3-5bf0-4748-837c-38f91848c712 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.249681 Jun 17 08:39:06.348619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 169/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:06 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:06.455562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-ba4560eb-aa2a-4488-8106-8c9c0c40c2f5 req-9fb6edcb-1c14-4852-9e30-c65f0f576f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d86760-ca41-4e0a-93bf-6ff2f8ba6b03", "tag": "fd13cfae-ed70-4dee-a58a-71692260d06a"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:06.464864 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ba4560eb-aa2a-4488-8106-8c9c0c40c2f5 req-9fb6edcb-1c14-4852-9e30-c65f0f576f1d service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:06.465324 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ba4560eb-aa2a-4488-8106-8c9c0c40c2f5 req-9fb6edcb-1c14-4852-9e30-c65f0f576f1d service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:06.476917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-ba4560eb-aa2a-4488-8106-8c9c0c40c2f5 req-9fb6edcb-1c14-4852-9e30-c65f0f576f1d service nova] Creating event network-changed:fd13cfae-ed70-4dee-a58a-71692260d06a for instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 on hv-cinder-80377 Jun 17 08:39:06.487354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-ba4560eb-aa2a-4488-8106-8c9c0c40c2f5 req-9fb6edcb-1c14-4852-9e30-c65f0f576f1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035717 Jun 17 08:39:06.488438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 166/335] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:06.743906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:06.744755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:06.762865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:06.763685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:06.765895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:06.766702 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:06.987588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:06.996431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9e0240e3-cb55-4009-af22-7ac02cad623e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.256854 Jun 17 08:39:06.997831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:06 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:07.042253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-787a3f4c-c536-4961-82a7-abf061098900 req-6c36ed7e-e6be-4147-b0cd-bdd62f678adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3375571-1c12-4180-8b41-fd69d8a33e12", "tag": "c4e04483-76d9-4a31-80a0-0c70e1a5498b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:07.054157 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-787a3f4c-c536-4961-82a7-abf061098900 req-6c36ed7e-e6be-4147-b0cd-bdd62f678adb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:07.054646 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-787a3f4c-c536-4961-82a7-abf061098900 req-6c36ed7e-e6be-4147-b0cd-bdd62f678adb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:07.082368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-787a3f4c-c536-4961-82a7-abf061098900 req-6c36ed7e-e6be-4147-b0cd-bdd62f678adb service nova] Creating event network-changed:c4e04483-76d9-4a31-80a0-0c70e1a5498b for instance b3375571-1c12-4180-8b41-fd69d8a33e12 on hv-cinder-80377 Jun 17 08:39:07.091230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-787a3f4c-c536-4961-82a7-abf061098900 req-6c36ed7e-e6be-4147-b0cd-bdd62f678adb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050773 Jun 17 08:39:07.092808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 167/337] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:07.364974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:07.366237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:07.373562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:07.374011 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:07.374790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:07.375219 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:07.819227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:07.827321 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0f89101a-728a-4138-a7ff-20696559a80d tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.466149 Jun 17 08:39:07.827901 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 171/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:07 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:08.018014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:08.019329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:08.028078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:08.028563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:08.033258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:08.033718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:08.175250 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:08.183176 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1bab934e-c20e-49c6-877e-ab2f6cc09f8c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.171502 Jun 17 08:39:08.183859 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 168/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:08 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:08.844412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:08.845066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:08.851518 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:08.852071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:08.853581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:08.853581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:09.020884 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:09.028369 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-797ac915-65b1-467e-b377-f5a581ea5cee tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.187760 Jun 17 08:39:09.028966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 172/340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:08 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:09.200996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:09.201772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:09.207945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:09.208833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:09.209681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:09.210191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:09.338946 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=4 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:09.357448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:09.365520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d5a2b26d-c430-43c4-8e4e-0415d757abcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.168662 Jun 17 08:39:09.366264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 169/341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:09 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:10.045189 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:10.045807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:10.052626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:10.053078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:10.054068 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:10.054958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:10.185810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:10.193438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5fb0acb2-fd73-4b04-ad01-cabb60afd0a2 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.152070 Jun 17 08:39:10.194180 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 173/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:10 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:10.384583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:10.385814 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:10.397652 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:10.398120 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:10.399229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:10.399675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:10.546768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:10.554877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e3f5e239-c530-454a-8ce3-e6407c7f072a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.174651 Jun 17 08:39:10.555534 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 170/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:10 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:11.211682 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:11.214046 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:11.223398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:11.224310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:11.225135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:11.225775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:11.438311 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:11.448456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-464111de-e697-45dd-90a5-5a6187e73387 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.240372 Jun 17 08:39:11.450107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 174/344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:11 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:11.577323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:11.577871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:11.579733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=16 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:11.584637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:11.585105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:11.585865 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:11.586299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:11.741065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:11.749041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-94caea98-815a-4bee-a886-ad280b9ab373 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.176328 Jun 17 08:39:11.749610 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 171/345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:11 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:12.438386 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:12.438921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:12.440755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=8 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:12.445981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.446439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.447210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.447651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.468325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:12.469264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:12.475160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3bfaf8cf-7348-4c76-b85c-6a1d64422963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/ips" status: 200 len: 144 microversion: 2.1 time: 0.040764 Jun 17 08:39:12.475568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.476063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 175/346] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:39:12 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:12.476181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.476885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.477327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.619830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:12.629670 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2ee1d7b1-509c-4d93-a5e4-91a4fffec314 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.166822 Jun 17 08:39:12.630243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 172/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:12 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:12.721578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-b9033ca8-196e-49bb-b3b8-26f96cb6bb2e req-e785dec7-dbc5-47a7-8c3e-2f9316036087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3375571-1c12-4180-8b41-fd69d8a33e12", "name": "network-vif-plugged", "status": "completed", "tag": "c4e04483-76d9-4a31-80a0-0c70e1a5498b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:12.737341 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-b9033ca8-196e-49bb-b3b8-26f96cb6bb2e req-e785dec7-dbc5-47a7-8c3e-2f9316036087 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.738244 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-b9033ca8-196e-49bb-b3b8-26f96cb6bb2e req-e785dec7-dbc5-47a7-8c3e-2f9316036087 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.752392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-b9033ca8-196e-49bb-b3b8-26f96cb6bb2e req-e785dec7-dbc5-47a7-8c3e-2f9316036087 service nova] Creating event network-vif-plugged:c4e04483-76d9-4a31-80a0-0c70e1a5498b for instance b3375571-1c12-4180-8b41-fd69d8a33e12 on hv-cinder-80377 Jun 17 08:39:12.758203 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-b9033ca8-196e-49bb-b3b8-26f96cb6bb2e req-e785dec7-dbc5-47a7-8c3e-2f9316036087 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040464 Jun 17 08:39:12.759348 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 176/348] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:12.767266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:12.768072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:12.776973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.777430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.778527 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:12.778984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:12.920115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:12.943004 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a5cc9938-dd5a-46cc-91a0-3d3baf3e5e62 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.179537 Jun 17 08:39:12.944018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 173/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:12 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:13.649728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:13.650424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:13.657468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:13.657919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:13.658689 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:13.659125 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:13.808154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:13.816525 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e5958c60-7b18-4e33-9ffa-e9c88c401e4e tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.171319 Jun 17 08:39:13.820626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 177/350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:13 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:13.959979 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:13.960798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:13.973317 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:13.973775 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:13.974574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:13.975013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:14.181545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:14.191444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e54dcfaf-3ac0-49e0-b4d1-9e670f88a03e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.235297 Jun 17 08:39:14.192441 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 174/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:13 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:14.834523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:14.837839 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:14.844784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:14.845237 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:14.847071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:14.847892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:14.998946 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:15.006632 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-89e71f0f-6458-4f4d-9565-d192c215b841 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1314 microversion: 2.1 time: 0.175941 Jun 17 08:39:15.007188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 178/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:14 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:15.227427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:15.228051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:15.238455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:15.238917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:15.240105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:15.240822 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:15.404804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:15.428330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0d6edd78-f465-4aa7-bbfa-888e9f3c80f6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.200166 Jun 17 08:39:15.428330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 175/353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:15 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:16.023440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:16.023955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:16.032097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.033385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.033835 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.034450 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.197873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:16.222559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d55e6c3a-5674-4d27-994f-d5ef82b1d4a4 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1464 microversion: 2.1 time: 0.200248 Jun 17 08:39:16.236865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 179/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:16 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1464 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:16.279505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142dd09b-4831-482b-93e7-18529e8b591a"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:16.283658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:16.285171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:16.287621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:16.299014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.299474 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.300263 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.301266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.301862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.302651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.303088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.307880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.346937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:39:16.846059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-af173568-a358-48c9-9545-ee568a029e90 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 204 len: 0 microversion: 2.1 time: 0.566786 Jun 17 08:39:16.846649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 180/355] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:39:16 2022] DELETE /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:39:16.855507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:16.856437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:16.863796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.864255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:16.865258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:16.865659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:17.044462 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:17.048991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:17.057620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-05a3c3b3-051f-4467-a949-a253e47d03e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.205536 Jun 17 08:39:17.057620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 181/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:16 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:17.072684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:17.073656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:17.081338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:17.082011 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:17.082786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:17.083759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:17.239374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:17.252561 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-961b89b8-0f95-4c09-963a-80d988cd1fc0 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1470 microversion: 2.1 time: 0.183712 Jun 17 08:39:17.253385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 182/357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:17 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:18.075079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:18.075903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:18.082850 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:18.083302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:18.084068 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:18.084525 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:18.284726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:18.294482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-edc47a5f-12a9-4ec0-8dbc-9408203c3697 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.223789 Jun 17 08:39:18.295297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 183/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:18 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:18.300322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:18.301162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:18.307482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:18.308155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:18.309858 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:18.312756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:18.489209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:18.498916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d251a451-2eb3-4b4d-bd86-329f8c7d5e15 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1470 microversion: 2.1 time: 0.202363 Jun 17 08:39:18.500171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 184/359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:18 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:19.028243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ac15d737-134d-4f81-b512-68bb7e529772 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.755049 Jun 17 08:39:19.029600 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 176/360] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:39:16 2022] POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments => generated 194 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:19.311641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:19.312275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:19.325996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:19.330831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:19.330831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:19.330831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:19.518584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:19.519450 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:19.530518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:19.535562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:19.541099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:19.542396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:19.543142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:19.546717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fdc7c39c-a023-465d-aaaf-d76299913558 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.239020 Jun 17 08:39:19.556539 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 185/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:19 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:19.734419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:19.748792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7d8adb5c-2a2a-472a-9faf-0c7a3eb5aed3 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1470 microversion: 2.1 time: 0.234570 Jun 17 08:39:19.751106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 177/362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:19 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:20.564818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:20.566185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:20.576258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:20.576258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:20.576258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:20.576258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:20.767166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:20.767869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:20.774620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:20.775177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:20.775852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:20.776279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:21.022104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:21.041283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c0f18eef-6426-4880-89e6-dba131d09cee tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.480746 Jun 17 08:39:21.042348 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 186/363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:20 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:21.127335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:21.129770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:21.140367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-084cd239-d75e-46c0-af8e-711996148d40 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1470 microversion: 2.1 time: 0.378042 Jun 17 08:39:21.141635 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 178/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:20 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:21.387520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-61f86f86-a400-4e41-819e-f7a5ead12666 req-14540101-8afa-4918-b2e8-6616a9d0b03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d86760-ca41-4e0a-93bf-6ff2f8ba6b03", "name": "network-vif-plugged", "status": "completed", "tag": "fd13cfae-ed70-4dee-a58a-71692260d06a"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:21.404650 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-61f86f86-a400-4e41-819e-f7a5ead12666 req-14540101-8afa-4918-b2e8-6616a9d0b03f service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:21.405972 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-61f86f86-a400-4e41-819e-f7a5ead12666 req-14540101-8afa-4918-b2e8-6616a9d0b03f service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:21.429813 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-61f86f86-a400-4e41-819e-f7a5ead12666 req-14540101-8afa-4918-b2e8-6616a9d0b03f service nova] Creating event network-vif-plugged:fd13cfae-ed70-4dee-a58a-71692260d06a for instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 on hv-cinder-80377 Jun 17 08:39:21.442583 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-61f86f86-a400-4e41-819e-f7a5ead12666 req-14540101-8afa-4918-b2e8-6616a9d0b03f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068000 Jun 17 08:39:21.444856 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 187/365] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:21.535511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-6e9c83d5-9ab9-47b4-9252-e53f447554bc req-cdf42113-de10-42f0-9e51-b0f289f35b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3375571-1c12-4180-8b41-fd69d8a33e12", "name": "network-vif-deleted", "tag": "c4e04483-76d9-4a31-80a0-0c70e1a5498b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:21.547095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6e9c83d5-9ab9-47b4-9252-e53f447554bc req-cdf42113-de10-42f0-9e51-b0f289f35b73 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:21.548142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6e9c83d5-9ab9-47b4-9252-e53f447554bc req-cdf42113-de10-42f0-9e51-b0f289f35b73 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:21.566235 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-6e9c83d5-9ab9-47b4-9252-e53f447554bc req-cdf42113-de10-42f0-9e51-b0f289f35b73 service nova] Creating event network-vif-deleted:c4e04483-76d9-4a31-80a0-0c70e1a5498b for instance b3375571-1c12-4180-8b41-fd69d8a33e12 on hv-cinder-80377 Jun 17 08:39:21.572316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-6e9c83d5-9ab9-47b4-9252-e53f447554bc req-cdf42113-de10-42f0-9e51-b0f289f35b73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041565 Jun 17 08:39:21.573143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 179/366] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:22.060796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:22.062065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:22.073786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:22.073786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:22.073786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:22.074112 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:22.159144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:22.160074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:22.177622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:22.178586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:22.179521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:22.180121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:22.268024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:22.268682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:22.269168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lazy-loading 'fault' on Instance uuid b3375571-1c12-4180-8b41-fd69d8a33e12 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:39:22.435425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:22.452745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-574a3afd-64d8-4791-a408-3718b1486be9 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1304 microversion: 2.1 time: 0.298254 Jun 17 08:39:22.453653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 180/367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:22 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:22.488220 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:22.499947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a21e49ae-958c-40a1-9069-74375e001351 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.444179 Jun 17 08:39:22.502066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 188/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:22 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:23.472828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:23.473395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:23.485380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:23.485857 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:23.486664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:23.487097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:23.521995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:23.522609 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:23.531468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:23.533364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:23.533364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:23.534085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:23.566255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:23.567023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:23.573714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lazy-loading 'fault' on Instance uuid b3375571-1c12-4180-8b41-fd69d8a33e12 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:39:23.740273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e83c8b08dba4ff0ae4a05395bd8f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c50da3e76414a17a53e2a931b6bc715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:23.748301 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ccbe4365-c616-481c-b22f-db5fe5a85172 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 200 len: 1304 microversion: 2.1 time: 0.281597 Jun 17 08:39:23.748920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 181/369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:23 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 1304 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:23.838594 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:23.847759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b9e46936-d481-445e-88e7-457328a6435a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1267 microversion: 2.1 time: 0.329839 Jun 17 08:39:23.848600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 189/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:23 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:24.766774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:24.766774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] [instance: b3375571-1c12-4180-8b41-fd69d8a33e12] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:24.775643 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:24.776595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:24.777629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:24.778516 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:24.795355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] HTTP exception thrown: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Request method failure captured: Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 HTTP/1.1 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD2fsbcNJXselpLht-sLfno_X0FM8clPyhiuJPoNeAuombTbD9-iRqRR0Us2MsY4n055cw8STkd7bfjVsvTKPrWW5KRCSYpdutMWloEFB66Fcc_6mcXsnt9wduXl_86XFzUDULFv40xUn6eAnUDgCX8uZMluMj8D1IPYHW_sTltQgwU Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 0c50da3e76414a17a53e2a931b6bc715 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesNegativeTest-598270283 Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:39:24.797209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c50da3e76414a17a53e2a931b6bc715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c50da3e76414a17a53e2a931b6bc715"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c50da3e76414a17a53e2a931b6bc715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c50da3e76414a17a53e2a931b6bc715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesNegativeTest-598270283 Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 0c50da3e76414a17a53e2a931b6bc715 Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesNegativeTest-598270283 Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesNegativeTest-598270283-project Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 3e83c8b08dba4ff0ae4a05395bd8f652 Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesNegativeTest-598270283-project Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. Jun 17 08:39:24.804272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'b3375571-1c12-4180-8b41-fd69d8a33e12'} Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:39:24.805682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. Jun 17 08:39:24.809798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:39:24.811795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] Returning 404 to user: Instance b3375571-1c12-4180-8b41-fd69d8a33e12 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:39:24.811795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b0abc486-632e-449c-9ebc-aaad964cfd98 tempest-VolumesNegativeTest-598270283 tempest-VolumesNegativeTest-598270283-project] 10.222.0.48 "GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12" status: 404 len: 111 microversion: 2.1 time: 0.037845 Jun 17 08:39:24.811795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 182/371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:24 2022] GET /compute/v2.1/servers/b3375571-1c12-4180-8b41-fd69d8a33e12 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:39:24.866018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:24.866643 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:24.873491 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:24.874024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:24.875102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:24.875606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:25.044837 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:25.052642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6b2f2fe6-5936-4f96-b514-8d881d602bf0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1454 microversion: 2.1 time: 0.190722 Jun 17 08:39:25.053225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 190/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:24 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:25.070127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:25.070829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:25.077495 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:25.078039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:25.078894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:25.079396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:25.258110 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:25.266472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d68ec6b0-e812-47b3-a982-014c750cb1b5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1454 microversion: 2.1 time: 0.200291 Jun 17 08:39:25.267373 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 183/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:25 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:27.478758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9894ee58-97a9-4ee5-89ae-312198d88c1c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Action: 'create', calling method: .version_select at 0x7ff0253990d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-32527161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+AxiSEDBuF4aTAA0Lda1YusRfPKI/2nLJmA7479eZIKoXvhvST7YXK043U+KFFuvc4GEQXQ53kw1Z+acaqFh+yyyAMWHTgQHmYJ80dtoUSpXJIvGStzsVUta1sUq21zg=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:27.501279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-9894ee58-97a9-4ee5-89ae-312198d88c1c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Getting quotas for project 86160ae3ef564baa92ba603c13d0bf5b. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:39:27.506937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-9894ee58-97a9-4ee5-89ae-312198d88c1c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Getting quotas for user 8c2e294be3d7494b80f994c7f58475c8 and project 86160ae3ef564baa92ba603c13d0bf5b. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:39:27.629305 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9894ee58-97a9-4ee5-89ae-312198d88c1c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.384657 Jun 17 08:39:27.637811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 191/374] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:39:27 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:39:28.018403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-13da3438-a867-429e-8a41-47fe9f48ff65 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:28.035539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13da3438-a867-429e-8a41-47fe9f48ff65 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:28.037240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13da3438-a867-429e-8a41-47fe9f48ff65 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:28.104194 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-13da3438-a867-429e-8a41-47fe9f48ff65 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Going to try to stop instance {{(pid=124545) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 08:39:28.229901 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-207f06f6-26ce-4b2c-b811-bae8b879062b req-20b54d79-e6a3-48d8-9284-7ff0a4994bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d86760-ca41-4e0a-93bf-6ff2f8ba6b03", "tag": "fd13cfae-ed70-4dee-a58a-71692260d06a"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:28.245930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-207f06f6-26ce-4b2c-b811-bae8b879062b req-20b54d79-e6a3-48d8-9284-7ff0a4994bd4 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:28.246724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-207f06f6-26ce-4b2c-b811-bae8b879062b req-20b54d79-e6a3-48d8-9284-7ff0a4994bd4 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:28.258862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-207f06f6-26ce-4b2c-b811-bae8b879062b req-20b54d79-e6a3-48d8-9284-7ff0a4994bd4 service nova] Creating event network-changed:fd13cfae-ed70-4dee-a58a-71692260d06a for instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 on hv-cinder-80377 Jun 17 08:39:28.264374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-207f06f6-26ce-4b2c-b811-bae8b879062b req-20b54d79-e6a3-48d8-9284-7ff0a4994bd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Jun 17 08:39:28.265197 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 192/375] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:39:28.327853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-13da3438-a867-429e-8a41-47fe9f48ff65 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action" status: 202 len: 0 microversion: 2.1 time: 0.314924 Jun 17 08:39:28.341322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:28.343439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:28.344717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 184/376] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:39:28 2022] POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:39:28.356118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:28.356515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:28.362889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:28.362889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:28.645018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:28.658060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b244b7ce-3f5a-4cb2-a92d-49228ffbe82c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.324496 Jun 17 08:39:28.672300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 193/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:28 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:29.679057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:29.680519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:29.688444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:29.689040 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:29.690029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:29.691091 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:29.849296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:29.871220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-827b8602-e140-4371-9bbc-2e346a858759 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.198540 Jun 17 08:39:29.874021 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 185/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:29 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:30.895417 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:30.896651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:30.902931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:30.905430 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:30.906108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:30.906950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:30.907723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:31.062883 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:31.073015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7726860f-2b2a-4781-94bc-2e1ead402701 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.186141 Jun 17 08:39:31.076550 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 194/379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:30 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:32.090633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:32.092508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:32.100011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:32.100454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:32.101266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:32.101886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:32.302634 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:32.311588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d3329809-e12e-4e0b-a0fd-fa2471792815 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.224241 Jun 17 08:39:32.313654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 186/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:32 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:33.330551 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:33.331208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:33.337634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:33.338078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:33.338836 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:33.339264 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:33.486358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:33.494690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6570876f-96b7-4012-a08e-fe6c6d8c1282 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.169142 Jun 17 08:39:33.495282 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 195/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:33 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:34.513391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:34.514086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:34.517350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=58 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:34.522068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:34.522515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:34.523276 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:34.523706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:34.659453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:34.667404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b0a0df6b-fd8d-43e2-ac0b-b5f2a7243ed8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.158012 Jun 17 08:39:34.667963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 187/382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:34 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:35.685460 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:35.686078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:35.693365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:35.693818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:35.694582 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:35.695020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:35.834977 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:35.842891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-363c9f68-afb2-4162-8fd7-6213cd1b8fae tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.161389 Jun 17 08:39:35.843438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 196/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:35 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:36.862391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:36.863260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:36.869961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:36.872046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:36.872046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:36.872046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:37.014163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:37.022166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-04e039ee-6542-4f56-83d6-45a05448b3a2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.164097 Jun 17 08:39:37.022724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 188/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:36 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:38.040084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:38.041146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:38.043569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:38.049390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:38.049843 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:38.050611 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:38.051050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:38.189510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:38.197360 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6e7961d6-1ff0-4e29-90bc-15ffe26045ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.161273 Jun 17 08:39:38.197930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 197/385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:38 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:39.214352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:39.214995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:39.221794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:39.222266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:39.223035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:39.223473 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:39.352013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:39.359944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c62ada30-2a5b-4b58-bc4c-743f7fbe515b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.149655 Jun 17 08:39:39.361065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 189/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:39 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:40.378506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:40.379122 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:40.385984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:40.386442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:40.387204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:40.387643 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:40.516560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:40.525211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-43620186-ac8a-4d7e-b26c-28f3145c379c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.151273 Jun 17 08:39:40.525781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 198/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:40 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:41.541864 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:41.542483 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:41.549105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:41.550427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:41.551530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:41.552258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:41.686823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:41.694911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a6ef6654-76f0-4b10-9472-013cf24f5c5e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.156877 Jun 17 08:39:41.695477 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 190/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:41 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:42.712606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:42.713249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:42.719736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:42.720191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:42.721000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:42.721429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:42.849164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:42.857175 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5421a46f-1dce-4ec6-89a9-cb10a12574ca tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.148529 Jun 17 08:39:42.857741 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 199/389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:42 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:43.874711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:43.875327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:43.882835 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:43.883537 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:43.884304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:43.884805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:44.022987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:44.030951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-45906786-c1ee-4659-b9e2-39d896d733cf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.160254 Jun 17 08:39:44.031522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 191/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:43 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:45.048768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:45.049414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:45.057045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:45.057505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:45.058253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:45.058692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:45.200180 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:45.203762 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:45.209900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2b6bffa1-ede2-46cb-8708-e70c0e0aa742 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.164862 Jun 17 08:39:45.213050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 200/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:45 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:46.227723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:46.228339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:46.234852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:46.235301 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:46.236061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:46.236523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:46.366641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:46.375019 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bebfa50d-e50d-40e9-8291-64c2dc7e5876 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.151103 Jun 17 08:39:46.375587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 192/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:46 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:47.395085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:47.395763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:47.404382 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:47.404854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:47.405622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:47.406060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:47.546997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:47.556475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-82886521-71ec-430a-8aa5-139718fff6cc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.166460 Jun 17 08:39:47.557089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 201/393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:47 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:48.573514 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:48.574131 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:48.580363 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:48.580856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:48.581625 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:48.582123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:48.711887 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:48.720077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b36bed50-32b7-430c-8b10-caf1d2883224 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.150410 Jun 17 08:39:48.720667 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 193/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:48 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:39:49.738252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:49.738985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:49.745594 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:49.746039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:49.746798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:49.747241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:49.877310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:49.886411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b2de0c7b-78bf-47b1-a6c1-17a1488b7595 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.151967 Jun 17 08:39:49.886980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 202/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:49 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:50.903582 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:50.904246 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:50.912002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:50.915579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:50.915579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:50.915579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:51.050659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:51.059066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-13829056-5e7e-45b5-8d6d-0b412c8bfb71 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.159448 Jun 17 08:39:51.059649 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 194/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:50 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:52.077173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:52.077792 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:52.084547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:52.085045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:52.085845 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:52.086326 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:52.224693 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:52.232772 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-176a31a6-d692-4d5e-aef1-4e64b7a4d97e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1722 microversion: 2.1 time: 0.159901 Jun 17 08:39:52.236561 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 203/397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:52 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:53.251133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:53.251743 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:53.258873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:53.259573 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:53.260324 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:53.260784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:53.263265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:39:53.391685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:53.400533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4c3b3171-30b0-4b7d-8b6a-b2f315f4c722 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1699 microversion: 2.1 time: 0.153394 Jun 17 08:39:53.401093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 195/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:53 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:53.417477 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-469c2333-3b8c-4c6c-94e5-2b147cab9eb2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:39:53.423881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-469c2333-3b8c-4c6c-94e5-2b147cab9eb2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:53.424330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-469c2333-3b8c-4c6c-94e5-2b147cab9eb2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:53.484717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-469c2333-3b8c-4c6c-94e5-2b147cab9eb2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Going to try to start instance {{(pid=124546) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 08:39:53.636325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-469c2333-3b8c-4c6c-94e5-2b147cab9eb2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action" status: 202 len: 0 microversion: 2.1 time: 0.222468 Jun 17 08:39:53.637172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 204/399] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:39:53 2022] POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:39:53.645920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:53.646539 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:53.652665 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:53.653122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:53.653882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:53.654321 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:53.788121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:53.796188 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-786ca952-61be-4986-afaf-371dd0bfc4c6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1708 microversion: 2.1 time: 0.154680 Jun 17 08:39:53.796770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 196/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:53 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:54.814125 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:54.814928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:54.823421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:54.824335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:54.834109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:54.834576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:54.990004 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:54.998238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3f671681-6232-4be8-96d4-1fe31b2c1d16 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1708 microversion: 2.1 time: 0.188282 Jun 17 08:39:54.999010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 205/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:54 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1708 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:56.016418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:56.017161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:56.024004 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:56.024459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:56.025265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:56.025710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:56.158844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:56.168317 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2e104a8e-ec43-4e8e-8f3c-5ae2cda68ca4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1708 microversion: 2.1 time: 0.155727 Jun 17 08:39:56.168913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 197/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:56 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:57.185919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:57.186667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:57.193902 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:57.194353 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:57.195125 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:57.195673 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:57.354717 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:57.362985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d5b82083-88ff-4cac-a149-67a37242140e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1708 microversion: 2.1 time: 0.181013 Jun 17 08:39:57.363542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 206/403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:57 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:58.380976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:58.383233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:58.388772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:58.389230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:58.390118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:58.390560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:58.521661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:58.529980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3493454c-673c-47e9-87d4-4b99eb11719b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1708 microversion: 2.1 time: 0.153560 Jun 17 08:39:58.530548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 198/404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:58 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:39:59.546947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:39:59.547581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:39:59.554453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:59.554920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:59.555688 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:39:59.556121 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:39:59.688295 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:39:59.696815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f735fd3f-50fb-445f-a5c6-3914fcab586b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1712 microversion: 2.1 time: 0.153766 Jun 17 08:39:59.697383 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 207/405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:39:59 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:23.179198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-425037061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-32527161", "security_groups": [{"name": "tempest-secgroup-smoke-1568488815"}], "networks": [{"uuid": "bfd9c61d-0622-4173-a05f-b8c3364fc498"}], "block_device_mapping_v2": [{"uuid": "14f6ec3b-9c03-4798-9138-0265ce663845", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:40:23.188026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=23 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:23.188714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=23 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:23.293456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] validate_networks() for [('bfd9c61d-0622-4173-a05f-b8c3364fc498', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:40:23.664987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:40:23.665410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:40:23.665883 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:40:23.666365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:40:23.666698 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:40:23.675808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:23.676249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:23.678401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:23.679138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:23.698350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Getting quotas for project 86160ae3ef564baa92ba603c13d0bf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:40:23.702259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Getting quotas for user 8c2e294be3d7494b80f994c7f58475c8 and project 86160ae3ef564baa92ba603c13d0bf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:40:23.760422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:40:23.762514 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14f6ec3b-9c03-4798-9138-0265ce663845',volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:40:24.258388 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c6ccf018-a2af-4f6f-a260-e0fe094da09a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.083113 Jun 17 08:40:24.259381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 199/406] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:40:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:40:24.269530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d70fba4a-0693-4fbe-9211-bf85d7eacf1d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:24.270144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d70fba4a-0693-4fbe-9211-bf85d7eacf1d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:24.273170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=27 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:24.273898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:24.326858 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d70fba4a-0693-4fbe-9211-bf85d7eacf1d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:24.333022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d70fba4a-0693-4fbe-9211-bf85d7eacf1d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1086 microversion: 2.1 time: 0.067490 Jun 17 08:40:24.333586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 208/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:24 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:25.351560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d7ef5d2a-6457-49a5-b6f9-e6b92b33abbb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:25.352211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d7ef5d2a-6457-49a5-b6f9-e6b92b33abbb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:25.462624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d7ef5d2a-6457-49a5-b6f9-e6b92b33abbb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:25.462624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d7ef5d2a-6457-49a5-b6f9-e6b92b33abbb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1086 microversion: 2.1 time: 0.073675 Jun 17 08:40:25.462624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 200/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:25 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1086 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:40:26.446107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:26.446784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:26.453929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:26.454378 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:26.456099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:26.456099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:26.518294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:26.526320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3a2bf51e-010e-41b4-8439-f5b6c43abae7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1184 microversion: 2.1 time: 0.085148 Jun 17 08:40:26.526877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 209/409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:26 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1184 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:27.543644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:27.544396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:27.563430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:27.567707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:27.571313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:27.571896 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:27.652381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:27.661711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f05668bb-0291-43ee-9a55-16a24f09c471 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1202 microversion: 2.1 time: 0.122344 Jun 17 08:40:27.662342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 201/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:27 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:28.680467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:28.681787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:28.694656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:28.694656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:28.694656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:28.694656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:28.862886 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:28.870880 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-68d0f5de-fa48-4d1d-9b6a-700354139295 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.195406 Jun 17 08:40:28.871603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 210/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:28 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:28.962197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-acf66ec5-d5e1-45db-806e-975f71975d13 req-e432aed9-7338-4173-a546-3455c3701e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:40:28.972558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-acf66ec5-d5e1-45db-806e-975f71975d13 req-e432aed9-7338-4173-a546-3455c3701e47 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:28.973249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-acf66ec5-d5e1-45db-806e-975f71975d13 req-e432aed9-7338-4173-a546-3455c3701e47 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:28.994268 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-acf66ec5-d5e1-45db-806e-975f71975d13 req-e432aed9-7338-4173-a546-3455c3701e47 service nova] Creating event network-changed:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:40:28.999570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-acf66ec5-d5e1-45db-806e-975f71975d13 req-e432aed9-7338-4173-a546-3455c3701e47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041619 Jun 17 08:40:29.000343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 202/412] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:40:29.887408 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:29.888057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:29.894866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:29.900278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:29.900278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:29.900278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:30.035166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:30.043393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c7e3452b-fae8-40f9-9ca9-f9f501639643 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.159864 Jun 17 08:40:30.043895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 211/413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:29 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:31.061580 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:31.062286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:31.070742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:31.071267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:31.072053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:31.072517 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:31.205682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:31.213613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-01ccda31-07b0-4276-83cc-98d1107292f4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.156754 Jun 17 08:40:31.214179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 203/414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:31 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:32.230463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:32.231076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:32.238174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:32.238628 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:32.239399 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:32.239882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:32.375259 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:32.383224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-70af09b1-6411-4805-b940-ce2a333ff265 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.156635 Jun 17 08:40:32.383812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:32 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:33.404958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:33.405889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:33.415234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:33.415533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:33.416470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:33.417811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:33.561790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:33.569289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cb97c1bd-017b-46cf-a90f-90a4af7ca087 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.168273 Jun 17 08:40:33.569859 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 204/416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:33 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:34.585634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:34.586279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:34.588397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:34.593214 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:34.593678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:34.594451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:34.594891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:34.730089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:34.737610 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b41433f8-c1a0-4c67-a8eb-c4f40c7896fd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.155846 Jun 17 08:40:34.738248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 213/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:34 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:35.755310 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:35.764558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:35.764558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:35.764558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=8 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:40:35.764558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:35.765008 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:35.765775 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:35.766208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:36.063380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:36.071647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e5877114-eba3-4350-9508-7bb5fd5c9452 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.320235 Jun 17 08:40:36.082761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 205/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:35 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:37.091434 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:37.092056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:37.098984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:37.105873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:37.105873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:37.105873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:37.294298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:37.301950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-34a8b466-de3d-475b-aefa-5d04ba375ff8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.214426 Jun 17 08:40:37.302583 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:37 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:38.320207 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:38.321362 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:38.328690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:38.329143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:38.329914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:38.330354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:38.463336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:38.470866 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-47cfcbfc-2b2e-4b0b-b1c1-3e913988c936 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.154882 Jun 17 08:40:38.471423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 206/420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:38 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:40:39.487151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:39.487700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:39.495261 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:39.495701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:39.496453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:39.496904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:39.627191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:39.635252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8e67c38c-b5aa-4676-8722-9b4d2f054ad8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.152025 Jun 17 08:40:39.635816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 215/421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:39 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:40.652787 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:40.653392 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:40.659844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:40.660292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:40.661104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:40.661540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:40.796641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:40.804125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6a2e30ff-f7a1-4d25-b40d-6de4b7c625a1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.156014 Jun 17 08:40:40.804734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 207/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:40 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:41.821440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:41.822055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:41.828560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:41.829019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:41.829793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:41.830233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:41.964143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:41.971569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b7b6759c-faf1-4b4d-95f7-a9f3c8a2611c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.154489 Jun 17 08:40:41.972124 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 216/423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:41 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:42.988383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:42.989003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:42.996964 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:42.997414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:42.998216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:42.998653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:43.150954 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:43.158877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b9ba2a60-6693-47bc-a1ff-5b8a60651600 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.174158 Jun 17 08:40:43.159807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 208/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:42 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:44.175866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:44.176398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:44.185020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:44.185471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:44.186322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:44.186778 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:44.329988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:44.338496 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3a57330e-fefa-41f5-9363-e05bf0eebb7c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.166646 Jun 17 08:40:44.346712 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 217/425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:44 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:44.531222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-6f861070-9c18-41f4-b5b4-7dbfcb928777 req-ba486760-3366-4255-b761-a46884fd6688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "name": "network-vif-plugged", "status": "completed", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:40:44.542163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6f861070-9c18-41f4-b5b4-7dbfcb928777 req-ba486760-3366-4255-b761-a46884fd6688 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:44.542617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6f861070-9c18-41f4-b5b4-7dbfcb928777 req-ba486760-3366-4255-b761-a46884fd6688 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:44.553721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-6f861070-9c18-41f4-b5b4-7dbfcb928777 req-ba486760-3366-4255-b761-a46884fd6688 service nova] Creating event network-vif-plugged:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:40:44.559480 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-6f861070-9c18-41f4-b5b4-7dbfcb928777 req-ba486760-3366-4255-b761-a46884fd6688 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Jun 17 08:40:44.560111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 209/426] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:40:45.363141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:45.363823 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:45.370375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:45.370827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:45.371590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:45.372018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:45.546225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:45.553728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e93f906e-c8c2-48a9-9bfb-bfda00921f78 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.194401 Jun 17 08:40:45.554829 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 218/427] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:45 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:46.575031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:46.575841 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:46.582390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:46.582925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:46.583908 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:46.584433 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:46.722340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:46.730522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2aad74d9-f7bd-4b8f-9719-ef6fa8c0652c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1258 microversion: 2.1 time: 0.161790 Jun 17 08:40:46.731076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 210/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:46 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:47.747990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:47.748691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:47.755131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:47.755573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:47.756322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:47.756779 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:47.900654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:47.911565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-922f2f1c-fb9c-4144-af54-03ae030225cd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1442 microversion: 2.1 time: 0.167290 Jun 17 08:40:47.913503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 219/429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:47 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:47.931076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:40:47.931693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:40:47.938289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:47.938741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:47.939504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:47.939937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:48.073532 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:40:48.080861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-80a00137-bdcd-4663-9ace-b8ee928d7acc tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1442 microversion: 2.1 time: 0.154428 Jun 17 08:40:48.081424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 211/430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:40:47 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:40:50.705789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-f362dc08-48e7-4e66-9d3e-88adb285780d req-1c5bd209-2e91-4119-ab90-bb378619e76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:40:50.715649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-f362dc08-48e7-4e66-9d3e-88adb285780d req-1c5bd209-2e91-4119-ab90-bb378619e76c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:40:50.716101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-f362dc08-48e7-4e66-9d3e-88adb285780d req-1c5bd209-2e91-4119-ab90-bb378619e76c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:40:50.727436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-f362dc08-48e7-4e66-9d3e-88adb285780d req-1c5bd209-2e91-4119-ab90-bb378619e76c service nova] Creating event network-changed:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:40:50.732570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-f362dc08-48e7-4e66-9d3e-88adb285780d req-1c5bd209-2e91-4119-ab90-bb378619e76c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030396 Jun 17 08:40:50.733160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 220/431] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:40:53.104562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:40:53.105226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 08:40:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:41:12.030916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:12.031660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=60 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:12.138979 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab68b17a-0476-4de3-8cb8-464e327606c9"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:12.140032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:12.146672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:12.147118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:12.147870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:12.148304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:13.172477 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e2b9ca9d-9c2b-4875-abea-21ecafcbc2cd tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.146687 Jun 17 08:41:13.173131 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 212/432] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:41:12 2022] POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 194 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:20.411303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=28 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:20.412048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=68 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:20.519831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:20.520362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:20.527055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:20.527618 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:20.529135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:20.529602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:20.651057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lazy-loading 'services' on Instance uuid 6d680267-4032-4899-9999-bd8fe751264c {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:41:21.066994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-07fcdad2-3dc1-4dc6-903b-af2011f1d8c8 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments/142dd09b-4831-482b-93e7-18529e8b591a" status: 202 len: 0 microversion: 2.1 time: 0.656997 Jun 17 08:41:21.067693 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 221/433] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:41:20 2022] DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments/142dd09b-4831-482b-93e7-18529e8b591a => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:41:21.714664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:21.719051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:21.722891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:21.723336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:21.724390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:21.724952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:21.750856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'flavor' on Instance uuid 4ee0482e-2772-4e98-9d63-7b1992339966 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:41:22.110736 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-51ffcb51-0a71-4ab9-bee7-83f92b3d69c8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/action" status: 200 len: 32 microversion: 2.1 time: 0.401004 Jun 17 08:41:22.111380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 213/434] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:41:21 2022] POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:41:22.121044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:22.122625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:22.129557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:22.130003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:22.130758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:22.131187 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:22.275226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:22.282583 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-80eb94fe-e994-4c82-bf4a-086a6c73feba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.165649 Jun 17 08:41:22.283158 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 222/435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:22 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:22.339457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bc12b386-f366-437f-82af-2cba5fd7473e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:22.346440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc12b386-f366-437f-82af-2cba5fd7473e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:22.347133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc12b386-f366-437f-82af-2cba5fd7473e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:22.370197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bc12b386-f366-437f-82af-2cba5fd7473e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Going to try to stop instance {{(pid=124545) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 08:41:22.640508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bc12b386-f366-437f-82af-2cba5fd7473e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action" status: 202 len: 0 microversion: 2.1 time: 0.305719 Jun 17 08:41:22.641349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 214/436] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:41:22 2022] POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:41:22.649363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:22.650030 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:22.657297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:22.657742 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:22.658513 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:22.658942 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:22.865250 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:22.872940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b25c9e8c-617d-4765-b666-fe3291a4c343 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.227345 Jun 17 08:41:22.873515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 223/437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:22 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:23.301238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:23.301851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:23.308084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:23.308556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:23.310455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:23.310890 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:23.441013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:23.448972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9fbc2243-a1ed-41db-a38e-b164533db2ad tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.152558 Jun 17 08:41:23.449540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 215/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:23 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:23.890617 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:23.891223 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:23.897936 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:23.898387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:23.899145 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:23.899577 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:24.038113 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:24.045771 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4a0b4a1e-c237-4cf6-9920-c3dbb85ac76e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.159308 Jun 17 08:41:24.046327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 224/439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:23 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:24.467155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:24.468007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:24.474361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:24.474813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:24.475585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:24.476021 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:24.604096 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:24.612165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-abf621b4-e0c3-4b27-a5da-4e422c36407e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.149288 Jun 17 08:41:24.612763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 216/440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:24 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:25.063727 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:25.064335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:25.070802 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:25.075267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:25.075267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:25.075267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:25.204945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:25.212291 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-462fbdac-b7de-438b-8e07-ef0869858ff3 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.153057 Jun 17 08:41:25.212896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 225/441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:25 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:25.629910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:25.630525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:25.637690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:25.638154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:25.638956 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:25.639393 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:25.767875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:25.776463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b8d0996-73f2-40f1-85f9-c83664df95b2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.150375 Jun 17 08:41:25.786942 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 217/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:25 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:26.231085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:26.232230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:26.238834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:26.239282 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:26.240163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:26.240745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:26.371362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:26.379721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-eff3a293-341f-4be6-956d-06add36819da tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.152619 Jun 17 08:41:26.380281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 226/443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:26 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:26.794829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:26.795611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:26.802172 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:26.802622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:26.803385 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:26.803819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:26.933361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:26.941522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0244efce-e8e0-4d37-a81b-f7d43303f567 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.151276 Jun 17 08:41:26.942095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 218/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:26 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:27.396929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:27.397549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:27.405136 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:27.405591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:27.406359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:27.406830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:27.567319 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:27.575836 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6ebebce3-6ba2-4b33-8982-ad6fc87a988e tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.182511 Jun 17 08:41:27.576543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 227/445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:27 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:27.958500 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:27.959123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:27.969632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:27.969632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:27.969632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:27.969632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:28.115295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:28.124135 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9262daf6-25ed-4b81-832a-24b8d2babdb5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.169507 Jun 17 08:41:28.124766 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 219/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:27 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:28.593759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:28.601140 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:28.601140 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:28.601342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:28.602066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:28.602506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:28.740070 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:28.747841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6cdccb57-0ad6-4f90-a749-c793eee92ad2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.158447 Jun 17 08:41:28.748512 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 228/447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:28 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:29.141405 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:29.149706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:29.149706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:29.149706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:29.150020 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:29.150289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:29.278742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:29.286759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-49422d59-3b8d-438f-a8da-2319a81c3c71 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.149224 Jun 17 08:41:29.287326 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 220/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:29 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:29.765011 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:29.765633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:29.773371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:29.773831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:29.774613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:29.775048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:29.914767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:29.922544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1ddbcf60-7361-4bff-9898-d8bd400925dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.161570 Jun 17 08:41:29.923067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 229/449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:29 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:30.304463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:30.305101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:30.312171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:30.312663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:30.313425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:30.313861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:30.452416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:30.460782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c20e452e-b10d-4f8d-a32f-fcd804564ab2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.159966 Jun 17 08:41:30.462560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 221/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:30 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:30.860843 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1963649396", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "networks": [{"uuid": "837e5458-2792-45e8-b5df-92b5fc62599c"}]}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:30.912710 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] validate_networks() for [('837e5458-2792-45e8-b5df-92b5fc62599c', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:41:30.939203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:30.939917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:30.945917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:30.946376 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:30.947154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:30.947594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:31.114627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:31.122692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-742a20b9-5d05-4b57-9a7b-6ab83b92759d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.187324 Jun 17 08:41:31.123278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 222/451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:30 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:31.373463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:41:31.373885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:41:31.374351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:41:31.374752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:41:31.375156 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:41:31.383878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:31.384320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:31.385142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:31.386863 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:31.404444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Getting quotas for project 8dfca5eaef124207812c35441a729493. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:41:31.408390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Getting quotas for user f4329d95a2764fc58b286f4e1f451b88 and project 8dfca5eaef124207812c35441a729493. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:41:31.419102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:41:31.421399 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:41:31.479403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:31.480023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:31.488285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:31.488806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:31.489583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:31.490018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:31.621062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:31.631397 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6365e5c0-acb8-468f-b9d5-883db4777c73 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.154696 Jun 17 08:41:31.632179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 223/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:31 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:31.632908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ad6c89bb-be6c-477d-b64d-65f501233043 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775726 Jun 17 08:41:31.633536 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 230/453] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:41:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:41:31.646783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-603eaa8f-cd78-4bce-8e3f-3d5535645940 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:31.647400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-603eaa8f-cd78-4bce-8e3f-3d5535645940 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:31.704551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-603eaa8f-cd78-4bce-8e3f-3d5535645940 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:31.711319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-603eaa8f-cd78-4bce-8e3f-3d5535645940 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1219 microversion: 2.1 time: 0.068675 Jun 17 08:41:31.711885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 224/454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:31 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:32.140250 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:32.140851 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:32.149325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:32.149779 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:32.150539 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:32.150975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:32.287518 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:32.296222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c7840f11-ec49-4bbc-b2af-d41b3d300767 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.160399 Jun 17 08:41:32.296790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 231/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:32 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:32.502874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:41:32.503425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 08:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:41:32.650304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:32.650934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:32.659589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:32.660051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:32.660857 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:32.661341 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:32.665889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:32.728548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-65937cb0-ebb1-4faf-8d9c-258873f0891a tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:32.729192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-65937cb0-ebb1-4faf-8d9c-258873f0891a tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:32.798174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-65937cb0-ebb1-4faf-8d9c-258873f0891a tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:32.804797 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-65937cb0-ebb1-4faf-8d9c-258873f0891a tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1219 microversion: 2.1 time: 0.080235 Jun 17 08:41:32.805357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 232/456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:32 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:32.821474 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:32.829470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ec1fc147-ddf8-4283-9c40-6bbaf2b6da94 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.183737 Jun 17 08:41:32.830029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:32 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:33.313826 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:33.314442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:33.320996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.321447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.322492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.322851 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.465459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:33.475575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-21694866-0d01-47cf-afb3-ce80415a6248 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1676 microversion: 2.1 time: 0.165675 Jun 17 08:41:33.476352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 233/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:33 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:33.822406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:33.823358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:33.831247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.831685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.832437 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.832890 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.846497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:33.847112 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:33.853027 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.853482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.854247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:33.854685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:33.903560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:33.911586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-948fa368-d7da-4d48-b77e-f89787d2ba51 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1215 microversion: 2.1 time: 0.093458 Jun 17 08:41:33.912376 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 226/459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:33 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:34.006297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:34.015021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a235c4ce-8c8d-424f-9b50-cc001ee7ced1 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.172352 Jun 17 08:41:34.015646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 234/460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:33 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:34.493259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:34.494871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:34.501429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.501873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.502620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.503050 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.636275 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:34.645424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-be4ed14a-3f1b-4b15-a70b-b99630fe9b87 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1653 microversion: 2.1 time: 0.156249 Jun 17 08:41:34.645995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 227/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:34 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:34.662406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cb84ee7c-13f1-470e-967c-5405e87df5b1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:34.669098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb84ee7c-13f1-470e-967c-5405e87df5b1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.669666 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb84ee7c-13f1-470e-967c-5405e87df5b1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.691445 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cb84ee7c-13f1-470e-967c-5405e87df5b1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Going to try to start instance {{(pid=124546) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 08:41:34.893448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cb84ee7c-13f1-470e-967c-5405e87df5b1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action" status: 202 len: 0 microversion: 2.1 time: 0.234565 Jun 17 08:41:34.893997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 235/462] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:41:34 2022] POST /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:41:34.902622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:34.908129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:34.910790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.911231 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.911992 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.912419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.930082 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:34.930827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:34.937516 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.937973 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:34.938744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:34.939183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:35.007890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:35.015997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a45ea06b-08da-40d9-8522-694056a740a4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1271 microversion: 2.1 time: 0.090118 Jun 17 08:41:35.016596 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 236/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:34 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:35.032319 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:35.032960 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:35.039024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:35.039489 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:35.040283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:35.040851 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:35.065490 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:35.072663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:35.081761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c3a9ae1f-d84d-450f-be0c-12d4b3ad163b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1662 microversion: 2.1 time: 0.183061 Jun 17 08:41:35.082403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 228/464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:34 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:35.196708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:35.205752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c692c852-2cd3-4828-9b46-761e3fec2e14 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.177183 Jun 17 08:41:35.209019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 237/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:35 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:36.034564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:36.035177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:36.041998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.042429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.043189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.043617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.099722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:36.100331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:36.107700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:36.108155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.108711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.109625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.109907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.115227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5f607443-2a03-47da-b661-8347d392a442 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1279 microversion: 2.1 time: 0.084774 Jun 17 08:41:36.125244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 229/466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:36 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:36.222847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:36.223666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:36.229673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.230132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.231031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:36.231647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:36.360406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:36.372731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b146e980-c6d2-487b-87e2-3ff0e0969cc0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1662 microversion: 2.1 time: 0.277127 Jun 17 08:41:36.383992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 238/467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:36 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:36.469640 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:36.477899 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6d457951-0018-4d90-b773-2ba85b829d99 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1737 microversion: 2.1 time: 0.258947 Jun 17 08:41:36.478738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 230/468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:36 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:37.132407 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:37.133110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:37.139579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.140061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.140875 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.141316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.277366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:37.285309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-843118a6-2c5d-4b5e-a8d5-f1216bc47126 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.156713 Jun 17 08:41:37.293388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 239/469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:37 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:37.390892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:37.391416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:37.397884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.398336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.399108 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.399548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.495243 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:37.495887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:37.503706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.505168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.505168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:37.505377 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:37.693728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:37.702285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5dd827b7-8adf-49c0-b483-bf18656cbd56 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1662 microversion: 2.1 time: 0.315682 Jun 17 08:41:37.703211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 231/470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:37 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1662 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:38.030931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:38.038930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b46ba970-71f8-444d-83af-ab02f29c8316 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1717 microversion: 2.1 time: 0.547604 Jun 17 08:41:38.039499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 240/471] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:37 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1717 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:38.146462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:38.146956 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:38.153060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.153541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.154305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.154940 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.304704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:38.305920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:38.309952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] HTTP exception thrown: Cannot 'detach_volume' instance 4ee0482e-2772-4e98-9d63-7b1992339966 while it is in vm_state rescued Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Request method failure captured: Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments/ab68b17a-0476-4de3-8cb8-464e327606c9 HTTP/1.1 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzkat9T4Cius2sftjM6S0vQhUcYbQphNwFQyaVGljL-n4LZeQQFxun03Oa_Bl3EGfeVjdnjbCa0XnSmpEvtSkzxiGSw8YodBzSxeNbFyWC-E7-L3RfpZPk_grbTBaUXJdJP15aHRPUo6rLiiHB_shDjrtfgfdobrtlc5tkSKmoGR30 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:41:38.311806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fb1df28c175c40b7a06d1f94ba780d28 Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:41:38.317914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Cannot 'detach_volume' instance 4ee0482e-2772-4e98-9d63-7b1992339966 while it is in vm_state rescued Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'server_id': '4ee0482e-2772-4e98-9d63-7b1992339966', 'id': 'ab68b17a-0476-4de3-8cb8-464e327606c9'} Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:41:38.318641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4ee0482e-2772-4e98-9d63-7b1992339966 while it is in vm_state rescued Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4ee0482e-2772-4e98-9d63-7b1992339966 while it is in vm_state rescued Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:41:38.319894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Returning 409 to user: Cannot 'detach_volume' instance 4ee0482e-2772-4e98-9d63-7b1992339966 while it is in vm_state rescued {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:41:38.321133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6753cd96-7ca4-411a-b160-46a1d78b9acb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments/ab68b17a-0476-4de3-8cb8-464e327606c9" status: 409 len: 152 microversion: 2.1 time: 0.171145 Jun 17 08:41:38.321133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 232/472] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:41:38 2022] DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments/ab68b17a-0476-4de3-8cb8-464e327606c9 => generated 152 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 08:41:38.321416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.321416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.321416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.321416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.322593 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:38.323125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:38.332607 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.333063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.333849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.334538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.545985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:38.552722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6d4e0f54-3909-4c85-b06b-16d933056eee tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.253386 Jun 17 08:41:38.553284 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 241/473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:38 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:38.720651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:38.721277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:38.727959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.728621 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.729397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.729867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.777281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f9250173-ebef-45aa-8edc-ac1fdb0c3ad2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/action" status: 202 len: 0 microversion: 2.1 time: 0.457946 Jun 17 08:41:38.780355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 233/474] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:41:38 2022] POST /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:41:38.787400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:38.788295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:38.797236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.797679 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:38.798507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:38.799039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:39.009472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:39.023954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2894daac-9c48-44e7-afc2-03ca56d982e9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1666 microversion: 2.1 time: 0.307976 Jun 17 08:41:39.024776 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 242/475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:38 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1666 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:39.067306 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:39.082263 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dfd033aa-f9a6-4d08-b1fd-9f5795fab14c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.299069 Jun 17 08:41:39.085030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 234/476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:38 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:39.189000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-c89078da-d561-4583-aab2-21bde6310211 req-fdf230f7-90c5-44b8-a8d2-9e025e810e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc83887-6eb9-4276-925b-a38e69f9926e", "tag": "f5f2fe52-36d4-4443-8e4d-95862e350e2a"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:39.197934 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-c89078da-d561-4583-aab2-21bde6310211 req-fdf230f7-90c5-44b8-a8d2-9e025e810e10 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:39.198450 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-c89078da-d561-4583-aab2-21bde6310211 req-fdf230f7-90c5-44b8-a8d2-9e025e810e10 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:39.212805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-c89078da-d561-4583-aab2-21bde6310211 req-fdf230f7-90c5-44b8-a8d2-9e025e810e10 service nova] Creating event network-changed:f5f2fe52-36d4-4443-8e4d-95862e350e2a for instance 3cc83887-6eb9-4276-925b-a38e69f9926e on hv-cinder-80377 Jun 17 08:41:39.219306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-c89078da-d561-4583-aab2-21bde6310211 req-fdf230f7-90c5-44b8-a8d2-9e025e810e10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180866 Jun 17 08:41:39.220342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 243/477] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:39.570320 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:39.571191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:39.579651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:39.580105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:39.581046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:39.581497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:39.721315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:39.728730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-412f20a3-32da-43c4-8c9f-bff0d11ff821 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.162377 Jun 17 08:41:39.737409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 235/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:39 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:40.100882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:40.101579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:40.108799 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:40.109521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:40.110848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:40.111532 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:40.243836 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:40.252052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c621b788-be5e-40d5-8aac-19145fab6653 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.155943 Jun 17 08:41:40.252656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 244/479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:40 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:40.745675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:40.746298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:40.752942 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:40.753397 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:40.754164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:40.754602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:40.882156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:40.890062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8cb87266-0d51-4b0b-95cc-c67e82858005 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.148235 Jun 17 08:41:40.893401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 236/480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:40 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:41.269915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:41.270554 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:41.277278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:41.277731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:41.278558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:41.279128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:41.394726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:41.413916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:41.422824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bf4ec538-3705-475b-96c8-559e3dae073f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.156763 Jun 17 08:41:41.423567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 245/481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:41 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:41.915075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:41.915075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:41.915075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:41.915869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:41.916361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:41.917152 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:41.917589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:42.047641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:42.055019 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a1cb44ef-f279-4742-a1ac-435735c38c0b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.151850 Jun 17 08:41:42.055574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 237/482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:41 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:42.440900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:42.441528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:42.448422 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:42.448905 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:42.449668 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:42.450107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:42.584604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:42.593278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cead115a-7a96-418f-90d7-1960491e9fa3 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.156190 Jun 17 08:41:42.593862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 246/483] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:42 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:41:43.071100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:43.071716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:43.074143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=55 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:43.079189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:43.079638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:43.080406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:43.080871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:43.212909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:43.220796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-22f1fbe2-ad34-4cdc-8941-439d9c316f4d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.153540 Jun 17 08:41:43.221356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 238/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:43 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:43.610857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:43.611536 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:43.613510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=8 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:43.618890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:43.619345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:43.626092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:43.626092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:43.757225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:43.765741 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cb6be289-89b1-44ee-9e05-0f86c81aa30f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.159017 Jun 17 08:41:43.766309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 247/485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:43 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:44.238302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:44.238919 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:44.245313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:44.245762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:44.246534 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:44.246974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:44.415174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:44.422675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-30534814-f84b-4ddc-b9d4-608548cbc326 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.188250 Jun 17 08:41:44.423234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 239/486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:44 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:44.782442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:44.783306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:44.790140 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:44.790595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:44.791363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:44.791800 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:44.928357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:44.936478 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-98d99bcf-0785-4f9a-9a25-462a5f075d0c tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1725 microversion: 2.1 time: 0.158082 Jun 17 08:41:44.937067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 248/487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:44 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:45.446285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:45.446929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:45.455544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:45.455996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:45.457308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:45.459590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:45.630313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:45.633743 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:41:45.638658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-115901c7-32e8-41fe-973b-99cdf5fdc779 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.201984 Jun 17 08:41:45.643127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 240/488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:45 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:45.954390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:45.955094 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:45.961698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:45.962146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:45.962926 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:45.963346 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.092132 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:46.100090 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-38390c75-be4b-4755-be4b-62a8c1f9ef7e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1731 microversion: 2.1 time: 0.149941 Jun 17 08:41:46.100678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 249/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:45 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:46.117339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:46.117836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:46.125098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:46.125556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.126336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:46.126775 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.206594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6d2f2e32-fd73-4d96-8b17-4a7932b9e224 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093356 Jun 17 08:41:46.207181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 241/490] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:41:46 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:46.657320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:46.657933 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:46.663914 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:46.664374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.665194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:46.665634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.834341 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:46.842017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-187d4655-1a20-46c1-977c-a42986b82f37 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.189282 Jun 17 08:41:46.842809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 250/491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:46 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:46.917689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-bb69557c-6244-4816-8c50-872c4bbb7f9b req-9a4ec23e-4d8d-4ecc-81d6-c13dd22c714e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc83887-6eb9-4276-925b-a38e69f9926e", "name": "network-vif-plugged", "status": "completed", "tag": "f5f2fe52-36d4-4443-8e4d-95862e350e2a"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:46.926358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-bb69557c-6244-4816-8c50-872c4bbb7f9b req-9a4ec23e-4d8d-4ecc-81d6-c13dd22c714e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:46.931505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-bb69557c-6244-4816-8c50-872c4bbb7f9b req-9a4ec23e-4d8d-4ecc-81d6-c13dd22c714e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:46.938612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-bb69557c-6244-4816-8c50-872c4bbb7f9b req-9a4ec23e-4d8d-4ecc-81d6-c13dd22c714e service nova] Creating event network-vif-plugged:f5f2fe52-36d4-4443-8e4d-95862e350e2a for instance 3cc83887-6eb9-4276-925b-a38e69f9926e on hv-cinder-80377 Jun 17 08:41:46.943567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-bb69557c-6244-4816-8c50-872c4bbb7f9b req-9a4ec23e-4d8d-4ecc-81d6-c13dd22c714e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096656 Jun 17 08:41:46.944162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 242/492] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:47.501743 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-63bd2350-d094-4dfa-9f59-acda52362d36 req-805cd9c4-73fe-4960-9fe3-bc5a8874b906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:47.512953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-63bd2350-d094-4dfa-9f59-acda52362d36 req-805cd9c4-73fe-4960-9fe3-bc5a8874b906 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:47.515218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-63bd2350-d094-4dfa-9f59-acda52362d36 req-805cd9c4-73fe-4960-9fe3-bc5a8874b906 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:47.530929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-63bd2350-d094-4dfa-9f59-acda52362d36 req-805cd9c4-73fe-4960-9fe3-bc5a8874b906 service nova] Creating event network-changed:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:41:47.537719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-63bd2350-d094-4dfa-9f59-acda52362d36 req-805cd9c4-73fe-4960-9fe3-bc5a8874b906 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040408 Jun 17 08:41:47.538913 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 251/493] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:47.859510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:47.860221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:47.867147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:47.867738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:47.868648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:47.869206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:48.102904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:48.111006 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-84dbf499-eb36-4f28-a6a5-a87f353cfbb0 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.256213 Jun 17 08:41:48.111581 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 243/494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:47 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:49.128700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:49.129411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:49.135621 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:49.136073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:49.136881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:49.137323 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:49.282427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:49.289958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-95cbd6e5-0c13-415e-a750-746bfd81d17f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.166015 Jun 17 08:41:49.290560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 252/495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:49 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:49.552827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-68be5bf0-971b-4890-a98d-c9a645a4c2f5 req-6953dcbe-3957-4356-b80b-0f19b654a4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:41:49.561745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-68be5bf0-971b-4890-a98d-c9a645a4c2f5 req-6953dcbe-3957-4356-b80b-0f19b654a4d9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:49.562188 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-68be5bf0-971b-4890-a98d-c9a645a4c2f5 req-6953dcbe-3957-4356-b80b-0f19b654a4d9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:49.573045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-68be5bf0-971b-4890-a98d-c9a645a4c2f5 req-6953dcbe-3957-4356-b80b-0f19b654a4d9 service nova] Creating event network-changed:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:41:49.578641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-68be5bf0-971b-4890-a98d-c9a645a4c2f5 req-6953dcbe-3957-4356-b80b-0f19b654a4d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029517 Jun 17 08:41:49.579215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 244/496] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:41:50.307302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:50.307911 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:50.315877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:50.316356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:50.317174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:50.318028 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:50.503697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:50.511296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ee7fce82-f472-4051-a553-8a2acfb839d8 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1319 microversion: 2.1 time: 0.207731 Jun 17 08:41:50.511961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 253/497] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:50 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:41:51.529294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:41:51.529987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:41:51.536898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:51.537348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:51.538155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:41:51.538593 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:41:51.668836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:41:51.676586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e885888f-9db3-4ec3-9a23-e002ea657e29 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1508 microversion: 2.1 time: 0.151572 Jun 17 08:41:51.677109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 245/498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:41:51 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:19.890721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de6ae97-5f8a-4e66-8aed-b9fe72505884", "device": "/dev/sdb"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:42:19.892307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:19.894541 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:19.895279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=90 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:19.900373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:19.900887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:19.901793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:19.902236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:20.677187 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7bef9c61-bbcc-48e7-b235-038c60010623 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "POST /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790873 Jun 17 08:42:20.677980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 254/499] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:42:19 2022] POST /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:42:25.536581 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:25.537203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:25.539367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=15 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:25.540056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=20 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:25.544814 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:25.545267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:25.546080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:25.546518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:25.570459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:42:25.921599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-79b5c853-2e3d-4d43-8a24-97f5e1b46c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 204 len: 0 microversion: 2.1 time: 0.388646 Jun 17 08:42:25.922412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 246/500] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:42:25 2022] DELETE /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:42:25.931022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:25.931706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:25.939508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:25.951893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:25.951893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:25.951893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:26.081063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:26.088590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-95cbd42f-44fe-4403-890e-f2e2df3118f5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1578 microversion: 2.1 time: 0.161823 Jun 17 08:42:26.089163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 255/501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:25 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:27.106148 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:27.106883 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:27.113844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:27.114296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:27.115068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:27.115506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:27.248644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:27.256173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-30d8e08c-821e-4922-b4be-767ee0eb95a6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1578 microversion: 2.1 time: 0.154226 Jun 17 08:42:27.256789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 247/502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:27 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:28.211821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:42:28.212344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 08:42:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:42:28.273753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:28.274639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:28.281211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:28.281668 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:28.282431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:28.282871 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:28.421117 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:28.428072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aa4713bb-a773-4797-b5c0-4afd219e9c28 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1578 microversion: 2.1 time: 0.158098 Jun 17 08:42:28.428663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 256/503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:28 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:29.446408 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:29.447582 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:29.452544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-1fbafeac-c10c-473d-80a1-505da6b4eb99 req-a5965244-5bd1-4ab5-8c39-182142022984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d86760-ca41-4e0a-93bf-6ff2f8ba6b03", "name": "network-vif-deleted", "tag": "fd13cfae-ed70-4dee-a58a-71692260d06a"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:42:29.455065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:29.455524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:29.456617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:29.457134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:29.466191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1fbafeac-c10c-473d-80a1-505da6b4eb99 req-a5965244-5bd1-4ab5-8c39-182142022984 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:29.477651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1fbafeac-c10c-473d-80a1-505da6b4eb99 req-a5965244-5bd1-4ab5-8c39-182142022984 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:29.492521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-1fbafeac-c10c-473d-80a1-505da6b4eb99 req-a5965244-5bd1-4ab5-8c39-182142022984 service nova] Creating event network-vif-deleted:fd13cfae-ed70-4dee-a58a-71692260d06a for instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 on hv-cinder-80377 Jun 17 08:42:29.505183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-1fbafeac-c10c-473d-80a1-505da6b4eb99 req-a5965244-5bd1-4ab5-8c39-182142022984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056635 Jun 17 08:42:29.506234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 257/504] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:42:29.545911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:29.554894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c5ff2766-878f-42cb-a0c3-288932127c0a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1510 microversion: 2.1 time: 0.112562 Jun 17 08:42:29.555643 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 248/505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:29 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1510 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:30.574294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:30.575000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:30.581835 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:30.582358 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:30.583176 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:30.583618 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:30.617029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:30.622787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:30.622787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lazy-loading 'fault' on Instance uuid 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:42:30.660664 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:30.669034 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-edf2645c-f493-4734-9a8a-bad13b8aac18 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 200 len: 1231 microversion: 2.1 time: 0.100004 Jun 17 08:42:30.669607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 258/506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:30 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:31.688819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:31.689440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:31.696121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:31.703553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:31.703553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:31.703553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:31.711390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] HTTP exception thrown: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Request method failure captured: Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 HTTP/1.1 Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD1kPfLyzF6yv-3ZrH-dhQM22uWWBA3QJCdxUSg5J6HfB7BYrZvcH_r1hsiU_ggADrX8rpR_sEsQS5iZNAMyjcCtSekjv-1oP9w8hGWIhGhxi1dFAPXPeFUcTIVvp6mB0WnGKszRv3Haf0blEnxxfiM0wGWz9BzKTJRICm1mGTU8S1Y Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:42:31.713041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-TestVolumeBootPattern-381248049 Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 94d49cbc2d5d458881d3c2a5880f9109 Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:42:31.714718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '98d86760-ca41-4e0a-93bf-6ff2f8ba6b03'} Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:42:31.715664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:42:31.717217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:42:31.718719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Returning 404 to user: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:42:31.718719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-20d487f4-a937-482e-b5a1-76fdc2d5f850 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 404 len: 111 microversion: 2.1 time: 0.030290 Jun 17 08:42:31.718719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 249/507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:31 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:42:31.809585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-194080690", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085413800", "security_groups": [{"name": "tempest-secgroup-smoke-1006178609"}], "block_device_mapping_v2": [{"uuid": "bff8b7cb-2d07-4ebd-84bb-d562d7a55669", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24510b06-bea9-4fd6-97a7-6277343ccc18"}]}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:42:31.921507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] validate_networks() for [('24510b06-bea9-4fd6-97a7-6277343ccc18', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:42:32.288271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:42:32.288741 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:42:32.289265 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:42:32.289670 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:42:32.290078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:42:32.299154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:32.299604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:32.300406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:32.300885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:32.317403 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:42:32.321522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for user 94d49cbc2d5d458881d3c2a5880f9109 and project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:42:32.378677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:42:32.380938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bff8b7cb-2d07-4ebd-84bb-d562d7a55669',volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:42:32.938523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2a5e4369-27ee-4220-b136-820f497b17ba tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.132726 Jun 17 08:42:32.939446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 259/508] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:42:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:42:32.955683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f2b46202-e5dd-4ef1-afdc-31c7c6fed0c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:32.956312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f2b46202-e5dd-4ef1-afdc-31c7c6fed0c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:33.013661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f2b46202-e5dd-4ef1-afdc-31c7c6fed0c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:33.022109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f2b46202-e5dd-4ef1-afdc-31c7c6fed0c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1094 microversion: 2.1 time: 0.071443 Jun 17 08:42:33.022661 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 250/509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:32 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:34.040301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:34.040908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:34.047988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:34.048437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:34.049228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:34.049665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:34.109520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:34.117639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-829f9fa0-0fab-4816-9afa-24d17eaf244a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1144 microversion: 2.1 time: 0.081687 Jun 17 08:42:34.118530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 260/510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:34 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:35.135054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:35.136434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:35.144347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:35.144878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:35.145887 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:35.146415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:35.208288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:35.216456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-05653c19-5f77-4ebd-9e7b-9d1d19e471e0 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1136 microversion: 2.1 time: 0.085736 Jun 17 08:42:35.217079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 251/511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:35 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:36.234301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:36.239862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:36.241979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:36.242435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:36.243338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:36.243781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:36.306878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:36.315323 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-45fdaa18-4772-4007-84ca-1b657a339fd6 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1192 microversion: 2.1 time: 0.085325 Jun 17 08:42:36.315886 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 261/512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:36 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:37.338501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:37.338501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:37.339425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:37.339894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:37.340700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:37.341142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:37.504547 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:37.512209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-49e836d8-8772-4d08-ba9a-5fee7d5eb4ec tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.184091 Jun 17 08:42:37.512806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 252/513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:37 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:38.529285 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:38.529890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:38.536387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:38.536988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:38.537748 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:38.538185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:38.671347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:38.679405 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-725699ae-f13b-436f-a8c0-1ea299bb9483 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.154315 Jun 17 08:42:38.679971 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 262/514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:38 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:39.696446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:39.697101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:39.704309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:39.704783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:39.705550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:39.705984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:39.843274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:39.850798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-94662d98-e665-4ce6-9ba8-7e7d06aa0166 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.158223 Jun 17 08:42:39.851368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 253/515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:39 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:40.868602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:40.869219 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:40.877095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:40.877550 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:40.878329 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:40.878954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:41.121185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:41.128801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fb87875f-77ee-4fc9-810f-bcb28354844b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.264120 Jun 17 08:42:41.133079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 263/516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:40 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:41.343880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-724db3e8-d3c3-4940-bdac-a21c6a6c6b43 req-b9007100-dcbf-4c61-889e-eef7cfbd60d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9c12f0-3345-45e1-bfad-670023235180", "tag": "0b636c68-8977-4624-b852-695f70fcb969"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:42:41.353402 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-724db3e8-d3c3-4940-bdac-a21c6a6c6b43 req-b9007100-dcbf-4c61-889e-eef7cfbd60d0 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:41.356808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-724db3e8-d3c3-4940-bdac-a21c6a6c6b43 req-b9007100-dcbf-4c61-889e-eef7cfbd60d0 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:41.368893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-724db3e8-d3c3-4940-bdac-a21c6a6c6b43 req-b9007100-dcbf-4c61-889e-eef7cfbd60d0 service nova] Creating event network-changed:0b636c68-8977-4624-b852-695f70fcb969 for instance 9a9c12f0-3345-45e1-bfad-670023235180 on hv-cinder-80377 Jun 17 08:42:41.373877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-724db3e8-d3c3-4940-bdac-a21c6a6c6b43 req-b9007100-dcbf-4c61-889e-eef7cfbd60d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036115 Jun 17 08:42:41.374978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 254/517] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:42:42.145322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:42.145860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:42.152510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:42.152965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:42.153728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:42.154160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:42.285040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:42.292419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d8af1198-d441-416e-98e8-3e777613a4d1 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.151065 Jun 17 08:42:42.293096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 264/518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:42 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:42:43.307843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:43.312643 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:43.315355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:43.319463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:43.319916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:43.320711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:43.321151 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:43.454733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:43.462182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3934ba2b-4b93-4647-b5df-13d07a6c7219 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1278 microversion: 2.1 time: 0.155748 Jun 17 08:42:43.466308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 255/519] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:43 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:44.479209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:44.479819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:44.481782 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:44.482447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=6 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:44.488067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:44.488546 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:44.489316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:44.489752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:44.626882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:44.634390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3688f316-4394-4080-8d44-8fec62c34577 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.159105 Jun 17 08:42:44.634953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 265/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:44 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:45.653759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:45.653759 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:45.661171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:45.661657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:45.662391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:45.662828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:45.794178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:45.801961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-31af11a8-8ab0-4674-8393-c043ef506eaf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.153485 Jun 17 08:42:45.802870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 256/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:45 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:46.819656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:46.820220 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:46.827683 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:46.828141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:46.828950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:46.829390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:46.963292 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:46.971805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f8eb4931-32e0-4647-80a4-711b2530f45a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.156594 Jun 17 08:42:46.972407 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 266/522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:46 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:47.989217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:47.989746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:47.995951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:47.996396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:47.997184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:47.997619 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:48.128604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:48.135998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a65f9a7c-f126-47f2-a0ff-ecd353cedbd7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.150740 Jun 17 08:42:48.136587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 257/523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:47 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:49.153212 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:49.154482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:49.161728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:49.162192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:49.163058 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:49.163495 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:49.348855 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:49.356444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-48206e7c-6c9c-4b7c-9347-2f05c086dcf3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.207377 Jun 17 08:42:49.357042 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 267/524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:49 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:50.375024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:50.375636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:50.382190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:50.382689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:50.383454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:50.383910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:50.515340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:50.522801 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-69e05348-c0b6-47ba-be7d-4a4a453290e8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.152417 Jun 17 08:42:50.523369 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 258/525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:50 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:51.540541 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:51.541074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:51.543351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:51.549088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:51.549533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:51.550297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:51.550730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:51.556558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:51.705373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:51.712678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fec84c1c-90e9-4231-96ab-2a6d22f65f01 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.176099 Jun 17 08:42:51.713233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 268/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:51 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:52.730034 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:52.730637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:52.737806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:52.738253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:52.739022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:52.739461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:52.877122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:52.884530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6a98d12a-488f-43c0-97aa-d0074fadc747 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.158407 Jun 17 08:42:52.885105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 259/527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:52 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:42:53.901445 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:53.902072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:53.909485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:53.909944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:53.910721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:53.911162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:54.044029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:54.052067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2849915b-8654-4db2-95eb-639b99babf1c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.155151 Jun 17 08:42:54.052680 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 269/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:53 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:54.461098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:54.461596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:54.469196 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:54.469641 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:54.470438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:54.470855 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:54.552375 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lazy-loading 'services' on Instance uuid 3cc83887-6eb9-4276-925b-a38e69f9926e {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:42:54.898958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2af09a93-aab7-4c8c-908f-eaa499e36203 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e/os-volume_attachments/4de6ae97-5f8a-4e66-8aed-b9fe72505884" status: 202 len: 0 microversion: 2.1 time: 0.441579 Jun 17 08:42:54.904329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 260/529] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:42:54 2022] DELETE /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e/os-volume_attachments/4de6ae97-5f8a-4e66-8aed-b9fe72505884 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:42:55.069036 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:55.069646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:55.076392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:55.076877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:55.078227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:55.078719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:55.211699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:55.219421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f5783e8a-e7e4-48ff-91bf-3e4f8ad02ac9 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.154451 Jun 17 08:42:55.220159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 270/530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:55 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:56.237588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:56.238290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:56.240215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:56.245316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:56.245771 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:56.246546 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:56.246986 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:56.251196 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:42:56.387310 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:56.395550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-52fc8765-c940-44d0-a58d-9282f63bd86e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.163402 Jun 17 08:42:56.396118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 261/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:56 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:57.083677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:57.084209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:57.090920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.099954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.099954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.099954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.117864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:42:57.412696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:57.413303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:57.420434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.420963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.422981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.423416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.566100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:57.573621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-57fc7715-c021-4d40-8fb8-dbc9ecba808a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.164785 Jun 17 08:42:57.574193 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 262/532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:57 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:42:57.646373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-31ded1e4-bf2d-4adb-8c34-aff10ca54460 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 204 len: 0 microversion: 2.1 time: 0.565779 Jun 17 08:42:57.646665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 271/533] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:42:57 2022] DELETE /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:42:57.656832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:57.657830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:57.666790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.667187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.668140 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:57.668613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:57.805958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:57.813700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-541234ec-c44d-4d81-af2b-2c592a828a13 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1514 microversion: 2.1 time: 0.161883 Jun 17 08:42:57.814279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 263/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:57 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:58.591471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:58.592171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:58.598635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.599087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.599852 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.600285 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.733424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:58.741964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fbc973c5-a094-42da-93e4-74a324020d5f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.154802 Jun 17 08:42:58.747479 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 272/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:58 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:58.834749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:58.835380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:58.842136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.842531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.843309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:58.843741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:58.975447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:58.988925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-97bc795f-7b8d-499d-af38-e9fa9d70ae4f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1514 microversion: 2.1 time: 0.152122 Jun 17 08:42:58.988925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 264/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:58 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:42:59.081334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-23ee0d0f-e7df-4a9d-97fd-60557f8c1baa req-a9bb1a14-1fd4-4990-b64d-01914b16af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9c12f0-3345-45e1-bfad-670023235180", "name": "network-vif-plugged", "status": "completed", "tag": "0b636c68-8977-4624-b852-695f70fcb969"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:42:59.089278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-23ee0d0f-e7df-4a9d-97fd-60557f8c1baa req-a9bb1a14-1fd4-4990-b64d-01914b16af1e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:59.089722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-23ee0d0f-e7df-4a9d-97fd-60557f8c1baa req-a9bb1a14-1fd4-4990-b64d-01914b16af1e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:59.101047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-23ee0d0f-e7df-4a9d-97fd-60557f8c1baa req-a9bb1a14-1fd4-4990-b64d-01914b16af1e service nova] Creating event network-vif-plugged:0b636c68-8977-4624-b852-695f70fcb969 for instance 9a9c12f0-3345-45e1-bfad-670023235180 on hv-cinder-80377 Jun 17 08:42:59.105730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-23ee0d0f-e7df-4a9d-97fd-60557f8c1baa req-a9bb1a14-1fd4-4990-b64d-01914b16af1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028403 Jun 17 08:42:59.106327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 273/537] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:42:59.764540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:42:59.765803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:42:59.772060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:59.772536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:59.773913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:42:59.773913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:42:59.908114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:42:59.915760 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-486c47f3-37c7-410a-a23e-4d690c2b4506 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.155222 Jun 17 08:42:59.916324 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 265/538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:59 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:00.003154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:00.003961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:00.010600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:00.011056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:00.011833 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:00.012270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:00.081820 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:00.090003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-28642dfb-f47c-47db-8a53-8d4c7bb4b4ff tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1472 microversion: 2.1 time: 0.092264 Jun 17 08:43:00.090847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 274/539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:42:59 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:00.320122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-1ce1dfb4-fbe1-46dc-bc2e-4f0d40362f0a req-e59b10f1-8586-4ce3-a076-fd2f44873ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc83887-6eb9-4276-925b-a38e69f9926e", "name": "network-vif-deleted", "tag": "f5f2fe52-36d4-4443-8e4d-95862e350e2a"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:00.329012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1ce1dfb4-fbe1-46dc-bc2e-4f0d40362f0a req-e59b10f1-8586-4ce3-a076-fd2f44873ff3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:00.329529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1ce1dfb4-fbe1-46dc-bc2e-4f0d40362f0a req-e59b10f1-8586-4ce3-a076-fd2f44873ff3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:00.340660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-1ce1dfb4-fbe1-46dc-bc2e-4f0d40362f0a req-e59b10f1-8586-4ce3-a076-fd2f44873ff3 service nova] Creating event network-vif-deleted:f5f2fe52-36d4-4443-8e4d-95862e350e2a for instance 3cc83887-6eb9-4276-925b-a38e69f9926e on hv-cinder-80377 Jun 17 08:43:00.345983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-1ce1dfb4-fbe1-46dc-bc2e-4f0d40362f0a req-e59b10f1-8586-4ce3-a076-fd2f44873ff3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082375 Jun 17 08:43:00.346556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 266/540] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:00.932481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:00.933150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:00.939253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:00.939704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:00.940457 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:00.941003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:01.079005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:01.086511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b6902c3f-50e0-4951-9b97-fe275c2ea6a5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1266 microversion: 2.1 time: 0.157918 Jun 17 08:43:01.087085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 275/541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:00 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:01.107540 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:01.108237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:01.115400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:01.115844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:01.116622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:01.117053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:01.150133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:01.150575 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:01.151013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lazy-loading 'fault' on Instance uuid 3cc83887-6eb9-4276-925b-a38e69f9926e {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:01.195080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:01.204086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0013fa9c-73a2-4298-851d-040c9a439061 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1309 microversion: 2.1 time: 0.099480 Jun 17 08:43:01.204671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 267/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:01 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:02.103002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:02.103627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:02.110725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.111168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.111933 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.112372 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.221793 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:02.222428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:02.228933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.229409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.230170 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.230603 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.251484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:02.251484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-45cbe5d5-2d1e-4c30-8e90-eb649d55045e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1453 microversion: 2.1 time: 0.151770 Jun 17 08:43:02.252258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 276/543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:02 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:02.267620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.268071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.268789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lazy-loading 'fault' on Instance uuid 3cc83887-6eb9-4276-925b-a38e69f9926e {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:02.268938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:02.269363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:02.275633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.276086 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.277148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:02.277593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:02.314289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:02.319902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ab49a9aa-51fa-442f-8f68-00d7457a569d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 200 len: 1309 microversion: 2.1 time: 0.102369 Jun 17 08:43:02.320555 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 268/544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:02 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:02.416261 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:02.423928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4d3e6278-f6c9-481f-ba97-32ac7450e0e3 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1453 microversion: 2.1 time: 0.160171 Jun 17 08:43:02.424506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 277/545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:02 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:03.337668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:03.338292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: 3cc83887-6eb9-4276-925b-a38e69f9926e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:03.344833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:03.345294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:03.346066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:03.346552 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:03.363326 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] HTTP exception thrown: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Request method failure captured: Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e HTTP/1.1 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD44wQ8qTLITfquFRfvyMB_P5x87rSxzS7GW7CArM9i8qCoCqqIozEtsXlXYHQE44eiYblYnB8zF669WSHJCO_ZAx90YPNeqo7V36kNfQJp5Q4shuwDwywmLHcgT3ScD3DQnPnjjBIFbnqSSgd0Pqie7oo6W2fyuyqtUtyaKEBou94s Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 8dfca5eaef124207812c35441a729493 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:43:03.365013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dfca5eaef124207812c35441a729493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8dfca5eaef124207812c35441a729493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8dfca5eaef124207812c35441a729493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dfca5eaef124207812c35441a729493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 8dfca5eaef124207812c35441a729493 Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesSnapshotTestJSON-265746882-project Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: f4329d95a2764fc58b286f4e1f451b88 Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesSnapshotTestJSON-265746882-project Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. Jun 17 08:43:03.366583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '3cc83887-6eb9-4276-925b-a38e69f9926e'} Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:43:03.367383 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. Jun 17 08:43:03.368745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:03.369840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Returning 404 to user: Instance 3cc83887-6eb9-4276-925b-a38e69f9926e could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:43:03.369840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e33e78ad-2913-40b7-b137-715efd9f73fc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e" status: 404 len: 111 microversion: 2.1 time: 0.032669 Jun 17 08:43:03.369840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 269/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:03 2022] GET /compute/v2.1/servers/3cc83887-6eb9-4276-925b-a38e69f9926e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:43:04.854750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-cd31125e-386b-42ec-8ec5-45bb0b088772 req-2e0adfa3-fbe8-430d-b4f9-fcef96fb4178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9c12f0-3345-45e1-bfad-670023235180", "tag": "0b636c68-8977-4624-b852-695f70fcb969"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:04.864892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-cd31125e-386b-42ec-8ec5-45bb0b088772 req-2e0adfa3-fbe8-430d-b4f9-fcef96fb4178 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:04.865474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-cd31125e-386b-42ec-8ec5-45bb0b088772 req-2e0adfa3-fbe8-430d-b4f9-fcef96fb4178 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:04.877519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-cd31125e-386b-42ec-8ec5-45bb0b088772 req-2e0adfa3-fbe8-430d-b4f9-fcef96fb4178 service nova] Creating event network-changed:0b636c68-8977-4624-b852-695f70fcb969 for instance 9a9c12f0-3345-45e1-bfad-670023235180 on hv-cinder-80377 Jun 17 08:43:04.882832 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-cd31125e-386b-42ec-8ec5-45bb0b088772 req-2e0adfa3-fbe8-430d-b4f9-fcef96fb4178 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Jun 17 08:43:04.883565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 278/547] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:09.703887 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:09.704922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:09.711554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:09.712006 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:09.712809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:09.713244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:09.743045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-324aabff-cabb-478b-8a59-f50e9bbbffd7 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043778 Jun 17 08:43:09.753978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 270/548] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:09 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:43:09.826003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:09.826586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:09.832998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:09.833446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:09.834204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:09.834639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:09.861067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:43:10.266765 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3e222716-248e-4d4c-81a3-e2473e4e9a19 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 204 len: 0 microversion: 2.1 time: 0.445153 Jun 17 08:43:10.267573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 279/549] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:43:09 2022] DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:43:10.275823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:10.276438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:10.283584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:10.284036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:10.284837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:10.285281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:10.416166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:10.424195 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3e3c959e-68ce-4594-b232-0842378c95dc tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1672 microversion: 2.1 time: 0.152278 Jun 17 08:43:10.426595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 271/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:10 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:10.991216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:10.991798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:10.998307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:10.998863 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.000041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:11.000603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.086784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'services' on Instance uuid 4ee0482e-2772-4e98-9d63-7b1992339966 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:11.441926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:11.442542 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:11.449391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:11.449844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.450623 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:11.451069 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.469199 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e7cc5c3a-020e-46fa-bd4d-6e6c10ddcb81 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments/ab68b17a-0476-4de3-8cb8-464e327606c9" status: 202 len: 0 microversion: 2.1 time: 0.478135 Jun 17 08:43:11.469897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 280/551] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:43:10 2022] DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments/ab68b17a-0476-4de3-8cb8-464e327606c9 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:43:11.478700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:11.480161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:11.488726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:11.489257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.490171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:11.490674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:11.522809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5f286aec-84e6-408f-9ec5-709a185d0de5 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Jun 17 08:43:11.523281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 281/552] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:11 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:11.587038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:11.594895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2f2e6fed-a094-4723-89ca-7aef919dfdf1 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1672 microversion: 2.1 time: 0.157483 Jun 17 08:43:11.595489 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 272/553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:11 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:12.535496 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:12.536413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:12.543433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:12.543879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:12.544670 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:12.545101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:12.550583 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:12.578680 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-238b60af-0052-498c-b7f4-cafa6015d97b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048063 Jun 17 08:43:12.579424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 282/554] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:12 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:12.616072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:12.616796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:12.624176 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:12.624685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:12.625723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:12.626169 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:12.627018 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-d57ff28e-1ed7-4ce8-b0ae-4d9d61a4d1f1 req-96047726-f5b6-4ca8-8823-aa06b0f713bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d680267-4032-4899-9999-bd8fe751264c", "name": "network-vif-deleted", "tag": "8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:12.635239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-d57ff28e-1ed7-4ce8-b0ae-4d9d61a4d1f1 req-96047726-f5b6-4ca8-8823-aa06b0f713bb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:12.635687 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-d57ff28e-1ed7-4ce8-b0ae-4d9d61a4d1f1 req-96047726-f5b6-4ca8-8823-aa06b0f713bb service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:12.647787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-d57ff28e-1ed7-4ce8-b0ae-4d9d61a4d1f1 req-96047726-f5b6-4ca8-8823-aa06b0f713bb service nova] Creating event network-vif-deleted:8a43e6d2-c6c4-47bc-b7a3-b97b6524b59b for instance 6d680267-4032-4899-9999-bd8fe751264c on hv-cinder-80377 Jun 17 08:43:12.656565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-d57ff28e-1ed7-4ce8-b0ae-4d9d61a4d1f1 req-96047726-f5b6-4ca8-8823-aa06b0f713bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029393 Jun 17 08:43:12.656565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 283/555] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:43:12.694023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:12.702298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-993e9561-e63f-4d0f-8546-86313fdaca5b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1604 microversion: 2.1 time: 0.091840 Jun 17 08:43:12.705351 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 273/556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:12 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1604 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:13.591317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:13.592342 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:13.599506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:13.599958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:13.600768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:13.601210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:13.633389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-76e8da90-ceb9-4e8a-a63e-abae5cc30f62 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047199 Jun 17 08:43:13.633982 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 284/557] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:13 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:13.719656 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:13.720213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:13.726650 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:13.727111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:13.727881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:13.728321 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:13.794453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:13.802472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75da5d50-6140-4e65-9219-4e9647224d6c tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1604 microversion: 2.1 time: 0.086754 Jun 17 08:43:13.803037 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 274/558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:13 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:14.646375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:14.647215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:14.654220 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:14.654670 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:14.655427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:14.656509 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:14.686240 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-06321339-e48f-4d5c-8011-17f3804db33a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Jun 17 08:43:14.694876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 285/559] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:14 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:14.819138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:14.819770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:14.826278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:14.826729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:14.827489 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:14.828597 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:14.890143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:14.898994 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bb186a78-7d47-471e-91e6-74c16f1b29ef tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1604 microversion: 2.1 time: 0.083611 Jun 17 08:43:14.899497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 275/560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:14 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1604 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:15.698830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:15.699678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:15.706485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:15.706938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:15.707704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:15.708145 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:15.737352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0dbea9bc-ff7a-43a3-abe5-2884a7a2619b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jun 17 08:43:15.737910 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 286/561] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:15 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:15.916515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:15.917147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:15.923997 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:15.924451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:15.925248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:15.925686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:15.989174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:15.996894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3c88910a-cadf-4c78-aaf8-a8e022d4aabf tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 200 len: 1322 microversion: 2.1 time: 0.084224 Jun 17 08:43:15.997457 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 276/562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:15 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 1322 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:16.552475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1034387439", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "networks": [{"uuid": "837e5458-2792-45e8-b5df-92b5fc62599c"}]}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:16.606814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] validate_networks() for [('837e5458-2792-45e8-b5df-92b5fc62599c', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:43:16.748259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:16.749240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:16.756906 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:16.757355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:16.758117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:16.759200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:16.792338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ad1a33a0-a0da-4aa3-931b-405cba174690 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047104 Jun 17 08:43:16.792338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 277/563] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:43:16 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 08:43:16.870512 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:16.871021 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:16.877666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:16.878266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:16.880276 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:16.880752 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:16.896856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:16.909349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:43:17.222426 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:43:17.222869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:43:17.223392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:43:17.223803 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:43:17.224238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:43:17.233359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.233811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.235744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.235878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.252242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Getting quotas for project 8dfca5eaef124207812c35441a729493. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:43:17.256195 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Getting quotas for user f4329d95a2764fc58b286f4e1f451b88 and project 8dfca5eaef124207812c35441a729493. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:43:17.267774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:43:17.270092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:43:17.281590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a5718a28-e681-4b61-b308-0eea1070da51 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 204 len: 0 microversion: 2.1 time: 0.414194 Jun 17 08:43:17.282551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 278/564] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:43:16 2022] DELETE /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:43:17.288145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:17.293091 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:17.294894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.295344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.296094 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.297302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.310729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c HTTP/1.1 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:43:17.312897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:43:17.314183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '6d680267-4032-4899-9999-bd8fe751264c'} Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:43:17.314987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:43:17.316230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:17.317602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:43:17.317602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b6965faa-20a4-47cc-a57a-a65a2b8ffb77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 404 len: 111 microversion: 2.1 time: 0.030607 Jun 17 08:43:17.317602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 279/565] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:17 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:43:17.319183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:17.319781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:17.325626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.327508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.327508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:17.327508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:17.420808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d5838fce-ab41-4122-ba9e-4561a8979c60 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871839 Jun 17 08:43:17.425146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 287/566] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:43:17.427685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-64e2f8b0-b58c-43a9-94b9-d53aea2d1013 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '.version_select at 0x7ff025330940>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:17.464815 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:17.473016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9de9e4aa-a697-4057-acfb-62f37560922f tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1691 microversion: 2.1 time: 0.157119 Jun 17 08:43:17.473604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 280/567] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:17 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:17.478117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5c6c020d-b17b-4fe7-89f7-875fbfe6854f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:17.479057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5c6c020d-b17b-4fe7-89f7-875fbfe6854f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:17.532546 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5c6c020d-b17b-4fe7-89f7-875fbfe6854f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:17.539174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5c6c020d-b17b-4fe7-89f7-875fbfe6854f tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1219 microversion: 2.1 time: 0.064529 Jun 17 08:43:17.539723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 281/568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:17 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:17.621989 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-64e2f8b0-b58c-43a9-94b9-d53aea2d1013 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239148950" status: 202 len: 0 microversion: 2.1 time: 0.198987 Jun 17 08:43:17.622572 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 288/569] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 08:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239148950 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:43:18.491061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:18.500072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:18.501596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:18.502043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:18.502816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:18.503245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:18.569019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6113003c-50c1-4f2d-aff5-db816479a878 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:18.572167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6113003c-50c1-4f2d-aff5-db816479a878 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:18.654447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6113003c-50c1-4f2d-aff5-db816479a878 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:18.662076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6113003c-50c1-4f2d-aff5-db816479a878 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1219 microversion: 2.1 time: 0.106977 Jun 17 08:43:18.662644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 289/570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:18 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:18.667149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9cf12566-9957-4dd7-a4b7-f65bd25db59b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: .version_select at 0x7ff02517e040>, body: {"keypair": {"name": "tempest-keypair-1702987403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcm80y9vMjPu7Wg5Rv7QtDGoOhLlVq9VhFy/ZHDFnizItEuYYBlARvHDPq8lzeAM6x0CG+TanntAfVS5NKE9lzu9yPslX2YaEyZ48OIRg7rVFgzEWQbbKtCBcJo6BT5NA=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:18.681570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-9cf12566-9957-4dd7-a4b7-f65bd25db59b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:43:18.685681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-9cf12566-9957-4dd7-a4b7-f65bd25db59b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for user af32d2a5a83546699f5e2caa3def410d and project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:43:18.714030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:18.722380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2ad57703-fb0c-40b6-b17b-756b04c53623 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1691 microversion: 2.1 time: 0.235503 Jun 17 08:43:18.722944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 282/571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:18 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:18.803607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9cf12566-9957-4dd7-a4b7-f65bd25db59b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139845 Jun 17 08:43:18.804286 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 290/572] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:43:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:19.679228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:19.679885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:19.686372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:19.686822 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:19.688177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:19.688657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:19.740819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:19.741359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:19.748693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:19.756394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:19.756394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:19.756394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:19.756394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:19.758002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b5d37ef1-e8d1-4261-a33d-e0991be44b20 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1223 microversion: 2.1 time: 0.082658 Jun 17 08:43:19.758581 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 283/573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:19 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:19.905472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:19.914324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e5fa3dab-ce0a-4c51-b775-f8e714718ccb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1691 microversion: 2.1 time: 0.178054 Jun 17 08:43:19.914920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 291/574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:19 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:20.775326 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:20.775987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:20.784049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:20.784782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:20.785945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:20.786600 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:20.883045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:20.891572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f3492c31-3f71-438b-bf54-b927882da736 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1223 microversion: 2.1 time: 0.119057 Jun 17 08:43:20.893064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 284/575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:20 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:20.933585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:20.934223 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:20.943152 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:20.943661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:20.944572 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:20.945077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:21.080006 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:21.087947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-402b741c-25a8-45b9-a9d7-2883e7b545c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1691 microversion: 2.1 time: 0.159163 Jun 17 08:43:21.090159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 292/576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:20 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:21.855405 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:21.855947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:21.862697 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:21.863146 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:21.863938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:21.864378 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:21.896315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lazy-loading 'flavor' on Instance uuid 07227f11-ad68-4c0b-8b4e-f70467ac4894 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:21.911236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:21.913965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:21.920216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:21.920918 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:21.926944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:21.926944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:21.987721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:21.995399 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-14ead0be-f8fd-4daa-91df-beef8da24a52 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1215 microversion: 2.1 time: 0.088264 Jun 17 08:43:21.995963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 293/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:21 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:22.001030 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1185393533", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40d8f93-627c-4d1e-91ba-cb4a2d9448c9"}], "security_groups": [{"name": "tempest-securitygroup--453042539"}], "key_name": "tempest-keypair-1702987403", "user_data": "}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:22.121631 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] validate_networks() for [('f40d8f93-627c-4d1e-91ba-cb4a2d9448c9', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:43:22.476979 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-39b0d406-8011-49a6-bb1d-d81fdebcb764 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "POST /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894/action" status: 202 len: 0 microversion: 2.1 time: 0.625243 Jun 17 08:43:22.481591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 285/578] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:43:21 2022] POST /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:43:22.491911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:22.492998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:22.499335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.501001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.502164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.502604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.510968 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:43:22.511389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:43:22.511856 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:43:22.512256 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:43:22.512876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:43:22.526338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.527092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.528301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.528950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.550546 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:43:22.553527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:22.557146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Getting quotas for user af32d2a5a83546699f5e2caa3def410d and project 5dacb56069b74ca6b04d4710a9c4bc96. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:43:22.572622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:43:22.575154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:43:22.602313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:22.605732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-49771455-63da-4c8f-b0cc-23afa85a518e tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1623 microversion: 2.1 time: 0.121822 Jun 17 08:43:22.606324 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 286/579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:22 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1623 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:22.620370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:22.621133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:22.628150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.628556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.629319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.629779 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.803150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:22.803150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bf3a59bb-65a6-492c-b0a7-bea8c4000521 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.187258 Jun 17 08:43:22.803150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 287/580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:22 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:22.803150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-6606f565-b913-43ea-b87d-d30ef99dd44a req-a083b15c-5308-4b62-a20d-a01cc7b8697e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee0482e-2772-4e98-9d63-7b1992339966", "name": "network-vif-deleted", "tag": "61f7f56e-7ef0-4456-8b38-ff366dd132f6"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:22.816823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6606f565-b913-43ea-b87d-d30ef99dd44a req-a083b15c-5308-4b62-a20d-a01cc7b8697e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:22.817550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6606f565-b913-43ea-b87d-d30ef99dd44a req-a083b15c-5308-4b62-a20d-a01cc7b8697e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:22.830010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-6606f565-b913-43ea-b87d-d30ef99dd44a req-a083b15c-5308-4b62-a20d-a01cc7b8697e service nova] Creating event network-vif-deleted:61f7f56e-7ef0-4456-8b38-ff366dd132f6 for instance 4ee0482e-2772-4e98-9d63-7b1992339966 on hv-cinder-80377 Jun 17 08:43:22.838046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-6606f565-b913-43ea-b87d-d30ef99dd44a req-a083b15c-5308-4b62-a20d-a01cc7b8697e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041099 Jun 17 08:43:22.838935 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 288/581] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:23.013051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:23.013877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:23.021698 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.022218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.023064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.023567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.100848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:23.105028 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-46874da5-bfb0-415a-8d97-9ce5f0a3c108 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.107965 Jun 17 08:43:23.106300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 294/582] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:43:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:43:23.117168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-77c5e5a9-e9b0-449d-8d3e-518bc985c25b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:23.118302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-77c5e5a9-e9b0-449d-8d3e-518bc985c25b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:23.118447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-62fd40df-9028-4239-a4d7-63af3bb923da tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1271 microversion: 2.1 time: 0.109688 Jun 17 08:43:23.128229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 289/583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:23 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:23.199189 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-77c5e5a9-e9b0-449d-8d3e-518bc985c25b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:23.206836 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-77c5e5a9-e9b0-449d-8d3e-518bc985c25b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1238 microversion: 2.1 time: 0.094118 Jun 17 08:43:23.208026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 295/584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:23 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:23.624143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:23.624852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:23.631392 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.631845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.632631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.633066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.664515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.664965 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.665417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 4ee0482e-2772-4e98-9d63-7b1992339966 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:23.710217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:23.717853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b8f64d12-5d14-4609-b919-13cb43880213 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 200 len: 1336 microversion: 2.1 time: 0.097571 Jun 17 08:43:23.719209 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 290/585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:23 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:23.819315 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:23.819512 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:23.825885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.826338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.827111 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:23.827549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:23.970310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:23.978694 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-298fd2ae-d54f-416f-b28a-08857dcc3296 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.164095 Jun 17 08:43:23.979530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 296/586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:23 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:24.135159 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:24.135781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:24.143092 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:24.143545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:24.144524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:24.144971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:24.213817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:24.222963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-014ac9c9-30c9-46a8-8a58-5e2fc2f7ca26 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1289 microversion: 2.1 time: 0.091497 Jun 17 08:43:24.223456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 291/587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:24 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:24.224620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1a965b5b-585d-43a7-a266-1b086ff7d8b0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:24.225427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1a965b5b-585d-43a7-a266-1b086ff7d8b0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:24.288345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1a965b5b-585d-43a7-a266-1b086ff7d8b0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:24.295083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1a965b5b-585d-43a7-a266-1b086ff7d8b0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1238 microversion: 2.1 time: 0.074577 Jun 17 08:43:24.295652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 297/588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:24 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:24.741297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:24.741934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 4ee0482e-2772-4e98-9d63-7b1992339966] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:24.747860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:24.748313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:24.749115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:24.749553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:24.762773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] HTTP exception thrown: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Request method failure captured: Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 HTTP/1.1 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzkat9T4Cius2sftjM6S0vQhUcYbQphNwFQyaVGljL-n4LZeQQFxun03Oa_Bl3EGfeVjdnjbCa0XnSmpEvtSkzxiGSw8YodBzSxeNbFyWC-E7-L3RfpZPk_grbTBaUXJdJP15aHRPUo6rLiiHB_shDjrtfgfdobrtlc5tkSKmoGR30 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:43:24.764591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fb1df28c175c40b7a06d1f94ba780d28 Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. Jun 17 08:43:24.767220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '4ee0482e-2772-4e98-9d63-7b1992339966'} Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:43:24.768081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. Jun 17 08:43:24.769560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:24.771098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Returning 404 to user: Instance 4ee0482e-2772-4e98-9d63-7b1992339966 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:43:24.771098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c43b787d-d630-4832-9074-c4c25253a773 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966" status: 404 len: 111 microversion: 2.1 time: 0.029359 Jun 17 08:43:24.771098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 292/589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:24 2022] GET /compute/v2.1/servers/4ee0482e-2772-4e98-9d63-7b1992339966 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:43:24.775765 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-deb0428e-553f-49cb-85f0-7271ca0c7e3b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '.version_select at 0x7ff02520a550>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:24.934062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-deb0428e-553f-49cb-85f0-7271ca0c7e3b tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354485464" status: 202 len: 0 microversion: 2.1 time: 0.161973 Jun 17 08:43:24.940466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 298/590] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 08:43:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354485464 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:43:24.995813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:24.996551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:25.003915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.015213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.015213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.015213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.166860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:25.174570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f51fb2ce-1906-434d-93c8-7e848e191b25 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.182743 Jun 17 08:43:25.175138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 293/591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:24 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:25.247536 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:25.248177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:25.255330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.255781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.256580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.257023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.311158 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:25.311773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:25.322097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.322549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.323323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.323763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.330938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:25.413659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:25.422943 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e0f7441e-b2bc-45d9-b811-2ccdf9ba68bb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1234 microversion: 2.1 time: 0.114397 Jun 17 08:43:25.423639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 294/592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:25 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1234 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:25.451132 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:25.460193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-36798fe9-5a17-4365-8817-945bbb8c83e6 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.216987 Jun 17 08:43:25.462315 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 299/593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:25 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:25.673726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-961a1cbb-a52d-4bd9-99f6-8b55e61c2cf3 req-d0056866-e228-4623-af44-a6b67c57be7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97abb6a-74ab-4810-b2cf-1d17badfa1b8", "tag": "cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:25.681956 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-961a1cbb-a52d-4bd9-99f6-8b55e61c2cf3 req-d0056866-e228-4623-af44-a6b67c57be7b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:25.682401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-961a1cbb-a52d-4bd9-99f6-8b55e61c2cf3 req-d0056866-e228-4623-af44-a6b67c57be7b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:25.693609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-961a1cbb-a52d-4bd9-99f6-8b55e61c2cf3 req-d0056866-e228-4623-af44-a6b67c57be7b service nova] Creating event network-changed:cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf for instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 on hv-cinder-80377 Jun 17 08:43:25.698589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-961a1cbb-a52d-4bd9-99f6-8b55e61c2cf3 req-d0056866-e228-4623-af44-a6b67c57be7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029388 Jun 17 08:43:25.699177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 295/594] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:26.191883 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:26.192626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:26.203381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.204170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.205150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.207333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.360051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:26.367755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-240aac48-ad3a-4afa-92a4-1bf42135aee5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.180437 Jun 17 08:43:26.368323 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 300/595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:26 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:26.441796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:26.442529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:26.444412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:26.449633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.456054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.456054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.456054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.477953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:26.478740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:26.485298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.485860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.486901 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:26.487413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:26.520683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:26.529203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f78efe18-6de6-48c1-af29-42fbcbfdcc25 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1298 microversion: 2.1 time: 0.092593 Jun 17 08:43:26.530916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 296/596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:26 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:26.637768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:26.646252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-62fbc95f-1a06-43c5-a6e5-f5d97709c97d tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.172203 Jun 17 08:43:26.646818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 301/597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:26 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:27.385434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:27.393077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:27.393666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.394116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.394876 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.395306 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.528611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:27.536847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6300bc8e-cc28-4e0e-9ed9-6242a1907944 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.155913 Jun 17 08:43:27.553334 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 297/598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:27 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:27.553926 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:27.553926 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:27.555347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.555841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.556625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.557057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.618147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:27.625564 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9b4555a3-d9f6-4d75-bc7f-cf3ff3b8f968 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1298 microversion: 2.1 time: 0.082061 Jun 17 08:43:27.626128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 302/599] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:27 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:27.664068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:27.664658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:27.666805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:27.672227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.672719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.673485 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:27.673922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:27.805311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:27.813115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ada71954-5e61-4b09-80f7-d19ee6906724 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.152766 Jun 17 08:43:27.813682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 298/600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:27 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:28.554196 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:28.554816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:28.561390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.561784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.563154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.563736 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.642598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:28.643672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:28.650792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.651245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.652011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.652445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.708839 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:28.716909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cec36e54-b0f7-4dfa-82af-67acb8015aca tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.166608 Jun 17 08:43:28.717480 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 303/601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:28 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:28.734001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:28.742096 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dda8b0da-f22f-46f0-b6b7-55d6743c36b9 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1298 microversion: 2.1 time: 0.103596 Jun 17 08:43:28.742676 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:28 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:28.830383 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:28.830999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:28.837144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.837591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.838338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:28.838768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:28.969486 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:28.976841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c2a5ce03-fbfa-4cb6-909c-af438666b405 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.150840 Jun 17 08:43:28.977411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 304/603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:28 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:29.280032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:29.280552 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:29.287315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.294429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:29.294429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.294429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:29.313867 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:43:29.734793 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:29.735418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:29.741924 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.742340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:29.743118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.743558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:29.889974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:29.906882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2a09fed6-1924-4d42-af84-66bd976de007 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.175905 Jun 17 08:43:29.916754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 305/604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:29 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:29.925263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:29.925887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:29.934595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.935052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:29.935834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:29.936526 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.076390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fea3195d-63f3-4ad8-b658-1a2a26837eb2 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 204 len: 0 microversion: 2.1 time: 0.800208 Jun 17 08:43:30.079769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 300/605] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:43:29 2022] DELETE /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:43:30.082380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:30.084962 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:30.087414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:30.088183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:30.091092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3972c1f6-288b-43e6-a470-808f0f234943 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1375 microversion: 2.1 time: 0.173238 Jun 17 08:43:30.091842 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 306/606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:29 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:30.096630 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:30.102848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:30.103043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.103494 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.104453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.104590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.104923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.105057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.105720 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.106145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.304825 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:30.309533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:30.318312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cdef6762-ac83-484f-9ce8-8a320ca44d4c tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.235744 Jun 17 08:43:30.318967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 301/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:30 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:30.320768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cadf48f5-1c63-44f8-9996-45ce62c96beb tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1508 microversion: 2.1 time: 0.227527 Jun 17 08:43:30.321409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 307/608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:30 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:30.923681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:30.924680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:30.933280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.934031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:30.935087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:30.935772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.111154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:31.111841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:31.118481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.118985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.119831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.120271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.137563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:31.146545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-406d06ee-5f07-4980-8b45-6200c3088a3b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.227245 Jun 17 08:43:31.147168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 302/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:30 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:31.247505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-0dfc6890-0c61-4afa-b605-92ba46ba5510 req-ca467c85-7a02-4b46-8690-c37b4c5b0a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210115ff-bb3b-4872-877f-1e3330d1218e", "tag": "a95437ba-ab43-4e46-898c-2582001bcddd"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:31.258728 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-0dfc6890-0c61-4afa-b605-92ba46ba5510 req-ca467c85-7a02-4b46-8690-c37b4c5b0a7b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.259531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-0dfc6890-0c61-4afa-b605-92ba46ba5510 req-ca467c85-7a02-4b46-8690-c37b4c5b0a7b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.274453 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-0dfc6890-0c61-4afa-b605-92ba46ba5510 req-ca467c85-7a02-4b46-8690-c37b4c5b0a7b service nova] Creating event network-changed:a95437ba-ab43-4e46-898c-2582001bcddd for instance 210115ff-bb3b-4872-877f-1e3330d1218e on hv-cinder-80377 Jun 17 08:43:31.279869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-0dfc6890-0c61-4afa-b605-92ba46ba5510 req-ca467c85-7a02-4b46-8690-c37b4c5b0a7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037638 Jun 17 08:43:31.280467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 303/610] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:31.336305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:31.338909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:31.366424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.367097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.368063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.368683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.376329 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:31.392632 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cd6a7f90-6301-48e6-b69f-15e7f33d33c2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.285761 Jun 17 08:43:31.393473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 308/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:31 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:31.412050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:31.412050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:31.417755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.421995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.423034 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:31.423644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:31.679175 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:31.688788 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b1f90e87-7bfa-4e93-a776-e2f1099d03ca tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.356386 Jun 17 08:43:31.698818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:31.700952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 304/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:31 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:31.709507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3b7b5041-bd44-4122-b726-660d8f2d85ca tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1508 microversion: 2.1 time: 0.305627 Jun 17 08:43:31.710427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 309/613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:31 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:32.044190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-71754609-1894-4dae-b3e3-79bcef045c2a req-7f0901cb-42e8-4ec0-997e-d2ce852a4197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670345b8-567e-4ba2-b484-d6b1dd74b8e7", "name": "network-vif-deleted", "tag": "8e23daa6-602c-488f-98a6-1fafaeaa3860"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:32.053490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-71754609-1894-4dae-b3e3-79bcef045c2a req-7f0901cb-42e8-4ec0-997e-d2ce852a4197 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.056228 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-71754609-1894-4dae-b3e3-79bcef045c2a req-7f0901cb-42e8-4ec0-997e-d2ce852a4197 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.067888 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-71754609-1894-4dae-b3e3-79bcef045c2a req-7f0901cb-42e8-4ec0-997e-d2ce852a4197 service nova] Creating event network-vif-deleted:8e23daa6-602c-488f-98a6-1fafaeaa3860 for instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 on hv-cinder-80377 Jun 17 08:43:32.072699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-71754609-1894-4dae-b3e3-79bcef045c2a req-7f0901cb-42e8-4ec0-997e-d2ce852a4197 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Jun 17 08:43:32.073314 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 305/614] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:32.164635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:32.165283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:32.171908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.172327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.173135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.173569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.319867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:32.323073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-97269211-db49-4037-9aa0-8ee5ee2c93c3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.162469 Jun 17 08:43:32.323662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 310/615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:32 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:32.411281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:32.428177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:32.428177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.428177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.428177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.429046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.556627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:32.564766 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d350d488-6371-4484-8ff3-31d93a72d147 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.157707 Jun 17 08:43:32.565549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 306/616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:32 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:32.707374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:32.707897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:32.709785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:32.714627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.715102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.715866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.716304 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.727673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:32.728289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:32.741368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.741368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.741368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.741368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.768666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.769115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.769569 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 670345b8-567e-4ba2-b484-d6b1dd74b8e7 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:32.840871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:32.840871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-40b5ada2-885f-4f1f-8758-0b79444cd9f7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1312 microversion: 2.1 time: 0.107289 Jun 17 08:43:32.840871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 307/617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:32 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:32.885920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:32.894083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a422edba-ea1c-426e-9cc0-4df3a37688b4 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.190768 Jun 17 08:43:32.894660 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 311/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:32 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:32.910648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-eb5ab26c-a0a5-49e9-b396-af108b58e350 req-17c7e69b-52b8-4382-8c5d-c68856210dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97abb6a-74ab-4810-b2cf-1d17badfa1b8", "name": "network-vif-plugged", "status": "completed", "tag": "cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:32.918848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-eb5ab26c-a0a5-49e9-b396-af108b58e350 req-17c7e69b-52b8-4382-8c5d-c68856210dba service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:32.919288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-eb5ab26c-a0a5-49e9-b396-af108b58e350 req-17c7e69b-52b8-4382-8c5d-c68856210dba service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:32.930948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-eb5ab26c-a0a5-49e9-b396-af108b58e350 req-17c7e69b-52b8-4382-8c5d-c68856210dba service nova] Creating event network-vif-plugged:cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf for instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 on hv-cinder-80377 Jun 17 08:43:32.935976 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-eb5ab26c-a0a5-49e9-b396-af108b58e350 req-17c7e69b-52b8-4382-8c5d-c68856210dba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030611 Jun 17 08:43:32.943368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 308/619] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:33.342252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:33.343040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:33.350934 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.351373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.352131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.352586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.481977 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:33.489731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c63187d9-fa99-4754-a1e2-f46e1e69cb2e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.152961 Jun 17 08:43:33.490298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 312/620] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:33 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:33.582877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:33.583586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:33.590385 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.590839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.591604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.592047 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.722030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:33.729511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-320ad16a-950f-4c17-bd83-4e0844d7be9b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.151519 Jun 17 08:43:33.730077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 309/621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:33 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:33.852961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:33.853578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:33.860092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.860569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.861336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.861791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.892032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.892482 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.892961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 670345b8-567e-4ba2-b484-d6b1dd74b8e7 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:33.910868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:33.911416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:33.917422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.917875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.918645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:33.919085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:33.933767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:33.941979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-06d9a046-2dc5-4df6-878a-2fa73de771b7 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1312 microversion: 2.1 time: 0.092866 Jun 17 08:43:33.942560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 313/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:33 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:34.048258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:34.052807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a5d6f0b2-8c59-4568-9774-70af3e68c716 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.145730 Jun 17 08:43:34.053367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 310/623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:33 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:34.507116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:34.507697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:34.509652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=22 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:34.515056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.515345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.516773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.517215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.649831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:34.658432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e3264e36-9329-4545-b294-1148fee77ba7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.155322 Jun 17 08:43:34.659002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 314/624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:34 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:34.746461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:34.747133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:34.755571 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.756290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.757270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.757973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.774817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:34.895876 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:34.903413 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-12757dea-b551-4f41-8bbb-52a250dd6572 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.160816 Jun 17 08:43:34.904262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 311/625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:34 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:34.959830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:34.960447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:34.966471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.966929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.967699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.968142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.997649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:34.998101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:34.998552 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 670345b8-567e-4ba2-b484-d6b1dd74b8e7 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:35.042620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:35.051671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2f3c3a29-aac1-4a0a-8c7e-bca4c0f05f91 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 200 len: 1312 microversion: 2.1 time: 0.095413 Jun 17 08:43:35.057057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 315/626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:34 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:35.070099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:35.070757 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:35.077907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.079043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:35.079998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.080357 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:35.525414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:35.534074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1f41e7c5-6ab9-4671-8b37-184316b98e9e tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.467942 Jun 17 08:43:35.534980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 312/627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:35 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:35.676706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:35.677355 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:35.685338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.685790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:35.686565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.687005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:35.818574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:35.825992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cb83694f-a428-4fa8-9b29-d47269785d86 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.154259 Jun 17 08:43:35.826559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 316/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:35 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:35.921166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:35.928622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:35.928988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.929444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:35.930204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:35.930645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.061567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:36.069469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6a23b5e3-75cd-4d51-8e2e-7695f4666751 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.152204 Jun 17 08:43:36.070029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 313/629] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:35 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:36.077853 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:36.079010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 670345b8-567e-4ba2-b484-d6b1dd74b8e7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:36.084960 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.085410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.086169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.086602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.100531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] HTTP exception thrown: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Request method failure captured: Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 HTTP/1.1 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzkat9T4Cius2sftjM6S0vQhUcYbQphNwFQyaVGljL-n4LZeQQFxun03Oa_Bl3EGfeVjdnjbCa0XnSmpEvtSkzxiGSw8YodBzSxeNbFyWC-E7-L3RfpZPk_grbTBaUXJdJP15aHRPUo6rLiiHB_shDjrtfgfdobrtlc5tkSKmoGR30 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:43:36.102142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: fb1df28c175c40b7a06d1f94ba780d28 Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. Jun 17 08:43:36.103649 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '670345b8-567e-4ba2-b484-d6b1dd74b8e7'} Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:43:36.104519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. Jun 17 08:43:36.106016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:43:36.107567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Returning 404 to user: Instance 670345b8-567e-4ba2-b484-d6b1dd74b8e7 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:43:36.107567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-924acdeb-8ab2-475b-92e1-5c6ce25e07f8 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7" status: 404 len: 111 microversion: 2.1 time: 0.029480 Jun 17 08:43:36.107567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 317/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:36 2022] GET /compute/v2.1/servers/670345b8-567e-4ba2-b484-d6b1dd74b8e7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:43:36.111957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:36.112455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:36.118507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.118951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.119734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.120168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.145673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:43:36.444060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-226ba65d-5535-4055-b14b-ae3afed44fba tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 204 len: 0 microversion: 2.1 time: 0.335829 Jun 17 08:43:36.444762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 314/631] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:43:36 2022] DELETE /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:43:36.452757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:36.454060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:36.460020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.460474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.461274 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.461711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.551762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:36.552460 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:36.558587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.558995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.559803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.560195 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.600296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:36.608635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4659aec0-09d9-419f-ba32-d9e12b428f7a tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.159676 Jun 17 08:43:36.609248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 318/632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:36 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:36.700513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:36.705192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8dc2e5ed-3e71-4046-b8c9-778c11b974fb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.157557 Jun 17 08:43:36.705773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 315/633] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:36 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:36.843009 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:36.844473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:36.851078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.851462 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.852231 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:36.852696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:36.988183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:36.995697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3852f54a-cd08-4eb1-a2c2-641b7b86f5a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.156568 Jun 17 08:43:36.997391 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 319/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:36 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:37.087491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:37.088123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:37.095653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.096097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.096897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.097380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.227852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:37.235186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3a6c04a5-95b2-4939-b47f-d40a54d53cfb tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.151721 Jun 17 08:43:37.235753 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 316/635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:37 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:37.626758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:37.627437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:37.634757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.635520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.636333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.636807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.722068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:37.722683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:37.728851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.729304 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.730071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:37.730510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:37.765320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:37.772834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-17d1f4dd-1f82-4181-b049-72eb2e774837 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.150587 Jun 17 08:43:37.773408 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 320/636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:37 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:37.863981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:37.871312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1c72513a-59fb-47e6-a797-369d7ea610eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1319 microversion: 2.1 time: 0.153201 Jun 17 08:43:37.871874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 317/637] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:37 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:38.014617 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:38.015833 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:38.024479 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.024955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.025721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.026150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.158795 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:38.166230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f6899e9a-7ab7-4d00-bfbf-6f53df766abb tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.156544 Jun 17 08:43:38.166791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 321/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:38 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:38.251100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:38.251844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:38.258527 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.259056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.259834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.260272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.394606 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:38.402229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bac53534-2143-4160-b145-594470f1a635 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.155014 Jun 17 08:43:38.402806 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 318/639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:38 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:38.797126 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:38.797763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:38.803859 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.804449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.805290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.805740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.810226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-92376645-7a94-4b9a-9e8c-ee3efd00923b req-79199d0a-8d68-40c6-87b4-76f5a3d0cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210115ff-bb3b-4872-877f-1e3330d1218e", "name": "network-vif-plugged", "status": "completed", "tag": "a95437ba-ab43-4e46-898c-2582001bcddd"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:38.819058 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-92376645-7a94-4b9a-9e8c-ee3efd00923b req-79199d0a-8d68-40c6-87b4-76f5a3d0cfa2 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.819506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-92376645-7a94-4b9a-9e8c-ee3efd00923b req-79199d0a-8d68-40c6-87b4-76f5a3d0cfa2 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.831022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-92376645-7a94-4b9a-9e8c-ee3efd00923b req-79199d0a-8d68-40c6-87b4-76f5a3d0cfa2 service nova] Creating event network-vif-plugged:a95437ba-ab43-4e46-898c-2582001bcddd for instance 210115ff-bb3b-4872-877f-1e3330d1218e on hv-cinder-80377 Jun 17 08:43:38.835849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-92376645-7a94-4b9a-9e8c-ee3efd00923b req-79199d0a-8d68-40c6-87b4-76f5a3d0cfa2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029310 Jun 17 08:43:38.836443 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 319/640] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:43:38.889086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:38.889742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:38.901526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.901981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.902768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:38.903205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:38.943251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:38.951316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b53d6005-1769-4f6a-8546-aac910ae4504 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1521 microversion: 2.1 time: 0.165057 Jun 17 08:43:38.951892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 322/641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:38 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:39.079718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:39.087709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-306e7507-71ef-4b50-b80f-48067e282c99 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1507 microversion: 2.1 time: 0.203125 Jun 17 08:43:39.088321 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 320/642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:38 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:39.105228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d6c2949-79a8-4ee1-b1d4-f53a138ff258", "device": "/dev/sdb"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:39.110215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:39.113316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.113768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.114554 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.114976 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.129690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:39.183390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:39.184240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:39.191524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.192111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.193047 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.193990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.439447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:39.447837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8a049a07-f565-43c0-91a6-7567155a9147 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.268500 Jun 17 08:43:39.448405 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 321/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:39 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:39.452848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:39.453803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:39.459565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.460013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.460801 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.461238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.626562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:39.633931 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-da8e9d65-28ce-439e-95f5-8c0f8dcedf7d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.184532 Jun 17 08:43:39.634498 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 322/644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:39 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:39.877191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-c2c5cf52-4d12-4401-912f-aba31ad30133 req-443bf3bb-eb9e-481e-af1f-3a18473b187b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8717f6aa-b085-47bb-b1cf-2d52ba7a84c8", "name": "network-vif-deleted", "tag": "92dbd3ea-5920-4627-a3de-530b8b0e917c"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:39.877191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-c2c5cf52-4d12-4401-912f-aba31ad30133 req-443bf3bb-eb9e-481e-af1f-3a18473b187b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.877191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-c2c5cf52-4d12-4401-912f-aba31ad30133 req-443bf3bb-eb9e-481e-af1f-3a18473b187b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.885406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-c2c5cf52-4d12-4401-912f-aba31ad30133 req-443bf3bb-eb9e-481e-af1f-3a18473b187b service nova] Creating event network-vif-deleted:92dbd3ea-5920-4627-a3de-530b8b0e917c for instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 on hv-cinder-80377 Jun 17 08:43:39.895225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-c2c5cf52-4d12-4401-912f-aba31ad30133 req-443bf3bb-eb9e-481e-af1f-3a18473b187b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Jun 17 08:43:39.896026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 323/645] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:43:39.969454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:39.970164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:39.976635 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.977091 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:39.977867 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:39.978303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.050345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:40.056623 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-acd20775-8fe8-4033-9472-c073fad6a7c0 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1479 microversion: 2.1 time: 0.091912 Jun 17 08:43:40.057183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 324/646] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:39 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1479 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:40.442616 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7ac76748-19d2-453e-ac71-44def7d418eb tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "POST /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.341072 Jun 17 08:43:40.443153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 323/647] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:43:39 2022] POST /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8/os-volume_attachments => generated 194 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:40.464844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:40.465472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:40.473083 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.473527 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.474380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.474770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.652328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:40.653193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:40.661238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.661941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.662814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.663326 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.673048 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:40.680862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d2b15997-d4b8-4002-aeaa-db96451b4a80 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1568 microversion: 2.1 time: 0.219910 Jun 17 08:43:40.681503 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 325/648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:40 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:40.697567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:40.698063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:40.704674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.705125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.705906 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.706340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.832824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:40.840921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-191b059f-b85d-4701-b706-f19071ac9b77 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1363 microversion: 2.1 time: 0.192641 Jun 17 08:43:40.852523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 324/649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:40 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:40.857610 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-08c553c6-7a86-4608-a20a-65af5db76ecd req-b63e7f95-b444-49e1-9b78-8ef71818dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "name": "network-vif-unplugged", "status": "completed", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:40.866281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-08c553c6-7a86-4608-a20a-65af5db76ecd req-b63e7f95-b444-49e1-9b78-8ef71818dd6a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:40.866790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-08c553c6-7a86-4608-a20a-65af5db76ecd req-b63e7f95-b444-49e1-9b78-8ef71818dd6a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:40.878312 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-08c553c6-7a86-4608-a20a-65af5db76ecd req-b63e7f95-b444-49e1-9b78-8ef71818dd6a service nova] Creating event network-vif-unplugged:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:43:40.883221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-08c553c6-7a86-4608-a20a-65af5db76ecd req-b63e7f95-b444-49e1-9b78-8ef71818dd6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029218 Jun 17 08:43:40.894849 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 325/650] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:40.966813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:41.064190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1652cbe8-bb98-47a8-bdc2-8060f5e1d2e9 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "POST /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894/action" status: 202 len: 0 microversion: 2.1 time: 0.370412 Jun 17 08:43:41.064837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 326/651] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:43:40 2022] POST /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:43:41.073505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:41.074144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:41.074283 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:41.074813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:41.081476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.082551 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.082775 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.083085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.083870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.084298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.084742 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.085730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.120920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.121358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.121986 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:41.186329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:41.194752 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e254cc1a-8290-45f2-ac2f-b1a644fd8903 tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1312 microversion: 2.1 time: 0.124254 Jun 17 08:43:41.195345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 327/652] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:41 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:41.252271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:41.261455 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6b460456-acb2-44a0-95fd-f709b1696ddd tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1576 microversion: 2.1 time: 0.192217 Jun 17 08:43:41.262535 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 326/653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:41 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:41.859161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:41.860303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:41.867380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.867834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:41.868622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:41.869057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.011700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:42.019902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-72374a09-55e1-4f99-8ce3-d0881272cbe2 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1549 microversion: 2.1 time: 0.164656 Jun 17 08:43:42.020465 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 328/654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:41 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:42.037044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:42.037553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:42.043964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.044417 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.045215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.045653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.143635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3e51feda-d8d2-45d6-b57c-d504085fbe9d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110312 Jun 17 08:43:42.144224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 327/655] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:43:42 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:43:42.214583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:42.215526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:42.224125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.224626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.225435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.225879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.258856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.259309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.259762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lazy-loading 'fault' on Instance uuid 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:43:42.279742 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:42.280697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:42.288102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.288920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.290964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:42.291647 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:42.307440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1df28c175c40b7a06d1f94ba780d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae365d6da0e846baa0056cb67ac716d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:42.316455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1b9bb56a-2ac8-44f7-b423-15d50db5275d tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 200 len: 1312 microversion: 2.1 time: 0.107295 Jun 17 08:43:42.326276 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 329/656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:42 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:42.447996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:42.457494 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-610c2296-2fce-42a3-ae80-8a94fadd2b32 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1516 microversion: 2.1 time: 0.182145 Jun 17 08:43:42.458093 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 328/657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:42 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:43.333448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:43.334267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] [instance: 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:43.341285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:43.341739 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:43.342497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:43.342928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:43.357135 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] HTTP exception thrown: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Request method failure captured: Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 HTTP/1.1 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzkat9T4Cius2sftjM6S0vQhUcYbQphNwFQyaVGljL-n4LZeQQFxun03Oa_Bl3EGfeVjdnjbCa0XnSmpEvtSkzxiGSw8YodBzSxeNbFyWC-E7-L3RfpZPk_grbTBaUXJdJP15aHRPUo6rLiiHB_shDjrtfgfdobrtlc5tkSKmoGR30 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:43:43.368080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ae365d6da0e846baa0056cb67ac716d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: ae365d6da0e846baa0056cb67ac716d6 Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069079350 Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: fb1df28c175c40b7a06d1f94ba780d28 Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069079350-project Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. Jun 17 08:43:43.369839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '8717f6aa-b085-47bb-b1cf-2d52ba7a84c8'} Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:43:43.370733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. Jun 17 08:43:43.372205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:43:43.373562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] Returning 404 to user: Instance 8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:43:43.373562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-14dd1d9a-e029-43b8-ba82-093a7104eaed tempest-ServerRescueNegativeTestJSON-1069079350 tempest-ServerRescueNegativeTestJSON-1069079350-project] 10.222.0.48 "GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8" status: 404 len: 111 microversion: 2.1 time: 0.031220 Jun 17 08:43:43.373562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 330/658] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:43 2022] GET /compute/v2.1/servers/8717f6aa-b085-47bb-b1cf-2d52ba7a84c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:43:43.475287 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:43.475904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:43.482476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:43.482937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:43.483699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:43.484135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:43.592448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-1d21cd54-56c7-40cf-b39f-95ee6276849e req-9cc74b25-79a1-4a5d-95df-58a5ad8f38f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210115ff-bb3b-4872-877f-1e3330d1218e", "tag": "a95437ba-ab43-4e46-898c-2582001bcddd"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:43.603063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1d21cd54-56c7-40cf-b39f-95ee6276849e req-9cc74b25-79a1-4a5d-95df-58a5ad8f38f9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:43.603996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1d21cd54-56c7-40cf-b39f-95ee6276849e req-9cc74b25-79a1-4a5d-95df-58a5ad8f38f9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:43.621446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-1d21cd54-56c7-40cf-b39f-95ee6276849e req-9cc74b25-79a1-4a5d-95df-58a5ad8f38f9 service nova] Creating event network-changed:a95437ba-ab43-4e46-898c-2582001bcddd for instance 210115ff-bb3b-4872-877f-1e3330d1218e on hv-cinder-80377 Jun 17 08:43:43.628409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-1d21cd54-56c7-40cf-b39f-95ee6276849e req-9cc74b25-79a1-4a5d-95df-58a5ad8f38f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039723 Jun 17 08:43:43.629236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 331/659] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:43:43.662280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:43.670273 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c1a53661-1e6f-42da-9ec3-cdc751eab538 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.198829 Jun 17 08:43:43.670885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 329/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:43 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:44.688168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:44.689057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:44.695717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:44.696572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:44.697570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:44.698077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:44.850278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:44.858761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6ae97adb-037e-4f8e-b528-bc393a7b945c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.175240 Jun 17 08:43:44.859336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 332/661] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:44 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:45.878097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:45.878714 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:45.885324 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:45.885775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:45.886542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:45.886975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:46.021467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:46.028970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-26b2f83b-7edc-46d3-9c71-66f2e444080d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.155350 Jun 17 08:43:46.029752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 330/662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:45 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:47.046378 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:47.047029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:47.053347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:47.054072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:47.055020 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:47.055686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:47.209940 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:47.218041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d7cca36b-0fcd-45bd-97b8-07d37d5a85bf tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.175590 Jun 17 08:43:47.219376 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 333/663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:47 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:48.234894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:48.235514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:48.242181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:48.242639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:48.243416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:48.243857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:48.389091 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:48.397906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-90424ab0-639e-46d7-ac1e-d7c3fa4a7986 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.166802 Jun 17 08:43:48.400524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 331/664] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:48 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:49.415023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:49.415646 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:49.423276 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:49.423730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:49.424519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:49.424967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:49.556853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:49.564645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e3bb115c-542e-4f38-a78b-46bd0698f0b8 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.153439 Jun 17 08:43:49.565202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 334/665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:49 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:50.581704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:50.582322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:50.588853 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:50.589309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:50.590170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:50.590613 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:50.795101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:50.803481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-428bb57c-4b0f-4877-b3a0-7458c758b6a5 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1518 microversion: 2.1 time: 0.225761 Jun 17 08:43:50.804205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 332/666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:50 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:51.820590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:51.821211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:51.828225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:51.828712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:51.829530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:51.829962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:52.074675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:52.085538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-27b178ce-a4da-4a73-a35a-24dfae72c37f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.268867 Jun 17 08:43:52.096755 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 335/667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:51 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:53.105681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:53.108067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:53.116325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:53.116838 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:53.117639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:53.118077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:53.484927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:53.493477 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-32570806-2410-4fdd-99db-549a15189830 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.393985 Jun 17 08:43:53.494091 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 333/668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:53 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:54.515199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:54.520273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:54.526139 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:54.527892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:54.528669 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:54.529693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:54.531963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:54.775550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:54.785950 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-88eeeb25-75ef-4ce1-a5dc-2db879ebbc0c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.277841 Jun 17 08:43:54.798043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 336/669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:54 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:55.804359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:55.805095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:55.811253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:55.811696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:55.814317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:55.815061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:56.038633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:56.050669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ee917f27-98d4-4eeb-bec4-886456430a7d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.250172 Jun 17 08:43:56.051591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 334/670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:55 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:56.408559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-afb62378-1d5d-4596-bf4f-8e65ffb6fb42 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: .version_select at 0x7ff02510f0d0>, body: {"keypair": {"name": "tempest-keypair-1341666417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxxayq9Yuc0fzbgqMd6RIJPN8T5Dpmmn+l6YjxYmSFn7upKuyk2VJgxBRI2at3P/uFH07sj43b4PTKpK0amEbFsvwY2g47rUhh1Ks+FGvv4vCl8URO50gOOc9Uu+xP8PQ=="}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:56.423192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-afb62378-1d5d-4596-bf4f-8e65ffb6fb42 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'key_pairs'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:43:56.427432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-afb62378-1d5d-4596-bf4f-8e65ffb6fb42 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for user 1885c809018b4f0890028ba202aa415b and project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'key_pairs'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:43:56.553410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-afb62378-1d5d-4596-bf4f-8e65ffb6fb42 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.279388 Jun 17 08:43:56.557057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 337/671] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 08:43:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 08:43:57.068195 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:57.068852 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:57.071229 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:57.076067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:57.076547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:57.077335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:57.077774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:57.248460 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:57.257406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-af56c8d4-ee68-41bf-a22d-0c1c4ef86e1b tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.193048 Jun 17 08:43:57.257976 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 335/672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:57 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:43:58.277447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:58.278224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:58.293930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:58.294556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:58.295500 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:58.296213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:58.542702 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:58.556764 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c82117b7-329c-4409-80fe-ab0f56ab783f tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.284905 Jun 17 08:43:58.568749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 338/673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:58 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:43:59.578242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:43:59.579064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:43:59.589154 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:59.590263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:59.590957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:43:59.591473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:43:59.631202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-654450641", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "704466d8-40db-4ba5-9430-c24f097c9174"}], "security_groups": [{"name": "tempest-securitygroup--1721065148"}], "key_name": "tempest-keypair-1341666417", "user_data": "}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:43:59.790096 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] validate_networks() for [('704466d8-40db-4ba5-9430-c24f097c9174', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:43:59.795163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:43:59.803671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-47e3d667-0645-4606-9fae-ccc0b209cf62 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.230931 Jun 17 08:43:59.804798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 336/674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:43:59 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:00.180552 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:44:00.180984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:44:00.181468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:44:00.181881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:44:00.182295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:44:00.192470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:00.193101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:00.193909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:00.194403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:00.212271 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:44:00.216480 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for user 1885c809018b4f0890028ba202aa415b and project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:44:00.228538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:44:00.230894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:44:00.399113 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4ff50670-73a8-41ff-990b-6419dc446bd5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.772192 Jun 17 08:44:00.399832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 339/675] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 08:43:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 17 08:44:00.411437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:00.412046 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:00.471889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:00.480517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:00.482062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:00.483202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f8e6847b-a188-4041-aaa3-bd97a7a9ba59 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1281 microversion: 2.20 time: 0.076824 Jun 17 08:44:00.486216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 337/676] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:00 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:00.821297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:00.821914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:00.827925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:00.828949 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:00.829819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:00.830255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:00.961666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:00.969929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0e5daf01-26b0-4973-9fe6-2514dc2c938e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.152960 Jun 17 08:44:00.970498 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 340/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:00 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:01.504007 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:01.504696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:01.561038 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:01.573965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:01.573965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:01.573965 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f06d930c-c4e6-4826-89b7-0410a847d67b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1281 microversion: 2.20 time: 0.072779 Jun 17 08:44:01.574306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 338/678] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:01 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:01.995088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:01.995688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:02.002370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:02.003034 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:02.003800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:02.004244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:02.133012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:02.140444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75560f7d-3eb7-4898-883f-07a3433fd529 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.149277 Jun 17 08:44:02.141931 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 341/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:01 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:02.590328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:02.590945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:02.598047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:02.598510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:02.599280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:02.599718 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:02.660733 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:02.671442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:02.673017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:02.674164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1d7758b3-3bf1-4f2f-ae93-59d4242b33cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1285 microversion: 2.20 time: 0.087797 Jun 17 08:44:02.674716 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 339/680] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:02 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:44:03.158570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:03.159124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:03.165707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:03.166154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:03.166916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:03.167348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:03.310380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:03.318834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aa880a5d-39f6-4117-a2e5-f785a5b46558 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.164616 Jun 17 08:44:03.319406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 342/681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:03 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:03.692050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:03.692705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:03.699310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:03.699762 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:03.700569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:03.701012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:03.761937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:03.770392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:03.771957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:03.773048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-02af1d10-b24c-4cd6-a96a-9c1a967f45dd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1277 microversion: 2.20 time: 0.085003 Jun 17 08:44:03.773607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 340/682] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:03 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:04.335784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:04.336400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:04.342961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:04.343456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:04.344408 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:04.344745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:04.560626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:04.569491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d24e0e12-9589-451e-a9bc-bea344e5ecc2 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.237509 Jun 17 08:44:04.570075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 343/683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:04 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:04.791185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:04.791798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:04.799349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:04.799805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:04.800646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:04.801085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:04.864721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:04.867310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:04.873949 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:04.876137 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:04.877159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-72cf5c5c-a002-4135-bada-80dfdff92e7f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1341 microversion: 2.20 time: 0.089978 Jun 17 08:44:04.877715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 341/684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:04 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:05.586825 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:05.587705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:05.595127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:05.595589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:05.596357 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:05.596821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:05.813389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:05.821446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cfc83aab-6a0b-460f-bfbd-f7eedcc1f2a4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.238492 Jun 17 08:44:05.823655 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 344/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:05 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:05.895853 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:05.896397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:05.906845 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:05.907301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:05.908097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:05.908557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:06.321057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:06.329816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:06.333246 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:06.333246 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2d90fe15-25f2-46b9-8869-f0b3cd7c43cc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.441652 Jun 17 08:44:06.333246 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 342/686] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:05 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:06.352926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:06.353427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:06.360074 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:06.360823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:06.361444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:06.362078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:06.440866 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:06.445927 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lazy-loading 'services' on Instance uuid b97abb6a-74ab-4810-b2cf-1d17badfa1b8 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:44:06.768571 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3c304dd2-02a6-44b1-81fa-31b71d4819b3 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8/os-volume_attachments/8d6c2949-79a8-4ee1-b1d4-f53a138ff258" status: 202 len: 0 microversion: 2.1 time: 0.419343 Jun 17 08:44:06.771430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 345/687] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:44:06 2022] DELETE /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8/os-volume_attachments/8d6c2949-79a8-4ee1-b1d4-f53a138ff258 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:44:06.838964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:06.846204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:06.846371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:06.846820 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:06.847579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:06.848012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:06.962990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-223fe97b-4217-4b8a-b697-639cb78a2277 req-871a9374-b17f-4818-b1c6-86f4b96fce84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:06.992093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-223fe97b-4217-4b8a-b697-639cb78a2277 req-871a9374-b17f-4818-b1c6-86f4b96fce84 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:06.993343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-223fe97b-4217-4b8a-b697-639cb78a2277 req-871a9374-b17f-4818-b1c6-86f4b96fce84 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:07.008226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-223fe97b-4217-4b8a-b697-639cb78a2277 req-871a9374-b17f-4818-b1c6-86f4b96fce84 service nova] Creating event network-changed:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:44:07.014902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-223fe97b-4217-4b8a-b697-639cb78a2277 req-871a9374-b17f-4818-b1c6-86f4b96fce84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054727 Jun 17 08:44:07.014902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 346/688] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:44:07.061750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:07.070428 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5c7a4c74-9e6c-4116-afb7-c0290229f4f3 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.235233 Jun 17 08:44:07.071192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 343/689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:06 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:07.264236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-7e12adff-e9cb-4b56-ba34-c4a77ad43dd1 req-b814979d-9cb6-4ffd-ae76-03ad6ec0ad02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "name": "network-vif-plugged", "status": "completed", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:07.273478 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7e12adff-e9cb-4b56-ba34-c4a77ad43dd1 req-b814979d-9cb6-4ffd-ae76-03ad6ec0ad02 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:07.273923 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7e12adff-e9cb-4b56-ba34-c4a77ad43dd1 req-b814979d-9cb6-4ffd-ae76-03ad6ec0ad02 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:07.287483 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-7e12adff-e9cb-4b56-ba34-c4a77ad43dd1 req-b814979d-9cb6-4ffd-ae76-03ad6ec0ad02 service nova] Creating event network-vif-plugged:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:44:07.293678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-7e12adff-e9cb-4b56-ba34-c4a77ad43dd1 req-b814979d-9cb6-4ffd-ae76-03ad6ec0ad02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034865 Jun 17 08:44:07.294277 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 347/690] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:07.353629 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:07.354248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:07.360472 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:07.360953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:07.361771 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:07.362207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:07.531436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:07.539487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:07.541015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:07.542114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-34cac235-0a73-4b80-ac64-09a2679e9d9b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.192556 Jun 17 08:44:07.542698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 344/691] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:07 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:08.088758 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:08.092854 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:08.096706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.097157 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.097918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.098354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.326177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:08.334367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b89ef898-ef03-42d7-976b-65fb72d7379c tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.249946 Jun 17 08:44:08.334934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 348/692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:08 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:08.560322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:08.560952 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:08.567663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.568108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.568888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.569319 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.702221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:08.710795 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:08.712307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:08.713448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-523a219c-fddf-49d6-94e2-237ca8f961b5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.157009 Jun 17 08:44:08.714013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 345/693] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:08 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:08.942315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:08.942819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:08.948882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.949334 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.950108 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:08.950553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:08.979399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:44:09.351097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:09.351724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:09.357758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.358211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.358972 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.359904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.388231 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-25bc01cc-e391-487d-871f-6944fef08188 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 204 len: 0 microversion: 2.1 time: 0.449426 Jun 17 08:44:09.388894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 349/694] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:44:08 2022] DELETE /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:44:09.397419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:09.398138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:09.404348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.404861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.405874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.406831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.545708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:09.553781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3368633e-1fbf-46a5-8cbd-9db72014d8b1 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.206529 Jun 17 08:44:09.554355 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 346/695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:09 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:09.573342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:09.581003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ae1e62d7-9b5c-4001-aa2b-001ba56be9b7 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1513 microversion: 2.1 time: 0.187789 Jun 17 08:44:09.581566 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 350/696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:09 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:09.731170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:09.731731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:09.739278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.739731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.740512 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:09.740941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:09.867039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:09.875095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:09.876783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:09.877874 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1c52fdb1-da3f-42b6-8905-dc2b9cf7b23f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.150675 Jun 17 08:44:09.878426 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 347/697] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:09 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:10.570851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:10.571467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:10.573934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:10.574614 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=10 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:10.579683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.580127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:10.580929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.581364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:10.597245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:10.598000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:10.604033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.604734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:10.605510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.605981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:10.784543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:10.787739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:10.792043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-65d4d716-7ed3-405d-8014-63bbe77016c7 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.225008 Jun 17 08:44:10.792629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 351/698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:10 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:10.795312 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-749a6069-a57a-405c-ae3a-09bae24a3c40 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1513 microversion: 2.1 time: 0.201919 Jun 17 08:44:10.795873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 348/699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:10 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:10.895918 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:10.896574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:10.902608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.903049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:10.903805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:10.904238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:11.038046 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:11.045948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:11.048312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:11.049558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-44f9afae-fe98-484b-9329-99b407ab04c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.157409 Jun 17 08:44:11.050117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 352/700] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:10 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:11.809385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:11.809994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:11.811933 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:11.812374 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:11.814204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:11.818060 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:11.818519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:11.819298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:11.819740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:11.820602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:11.821053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:11.821807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:11.822254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:12.018590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:12.021530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:12.026467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9814c113-965a-4047-aa49-1466cab6570e tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1574 microversion: 2.1 time: 0.220935 Jun 17 08:44:12.027155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 349/701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:11 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:12.030087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-240402b6-3c4c-482a-a0a3-2f3bf0f545bc tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1513 microversion: 2.1 time: 0.221390 Jun 17 08:44:12.030996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 353/702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:11 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:12.067729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:12.068299 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:12.074539 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:12.074954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:12.075712 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:12.076166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:12.206234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:12.214106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:12.215604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:12.216728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7db9ae35-52d4-4cac-b539-02236d9e5764 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.152958 Jun 17 08:44:12.217283 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 350/703] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:12 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:13.045116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:13.045645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:13.047331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:13.048063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:13.052578 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.053038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.053824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.054258 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.055665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.056129 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.056954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.057390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.258029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:13.265690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:13.266357 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d9c72fa4-57f9-4b42-acb1-0ec36daaf8be tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1561 microversion: 2.1 time: 0.224654 Jun 17 08:44:13.268523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 354/704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:13 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:13.272106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:13.272755 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:13.276519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a1e04588-fac4-4e1b-8837-ca372c0cd7ec tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1513 microversion: 2.1 time: 0.232964 Jun 17 08:44:13.277322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 351/705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:13 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:44:13.279518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.279971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.281032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:13.281484 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:13.419618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:13.427937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:13.429821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:13.431007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7fd666af-1f5d-4e32-be1a-9813fc5b49ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.162805 Jun 17 08:44:13.431560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 355/706] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:13 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:14.294234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:14.294876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:14.301773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:14.302233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:14.303003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:14.303442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:14.449870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:14.450494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:14.457499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:14.457953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:14.461910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:14.461910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:14.483806 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:14.491437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-23bcca77-aeeb-4cad-b497-7150128a1792 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1513 microversion: 2.1 time: 0.201116 Jun 17 08:44:14.492020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 352/707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:14 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:14.627721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:14.635955 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:14.637526 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:14.638628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a6932749-c6a8-4156-a56c-b6540a7a5abf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.192694 Jun 17 08:44:14.639185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 356/708] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:14 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:44:14.680645 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-33706b1f-f2f3-43d2-bcce-7f4b16df679a req-d22733e6-e925-4e38-a2d0-a602cc87be66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97abb6a-74ab-4810-b2cf-1d17badfa1b8", "name": "network-vif-deleted", "tag": "cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:14.689170 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-33706b1f-f2f3-43d2-bcce-7f4b16df679a req-d22733e6-e925-4e38-a2d0-a602cc87be66 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:14.689546 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-33706b1f-f2f3-43d2-bcce-7f4b16df679a req-d22733e6-e925-4e38-a2d0-a602cc87be66 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:14.700061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-33706b1f-f2f3-43d2-bcce-7f4b16df679a req-d22733e6-e925-4e38-a2d0-a602cc87be66 service nova] Creating event network-vif-deleted:cb9965cc-3e53-4391-ab18-1c8cc2b1b6cf for instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 on hv-cinder-80377 Jun 17 08:44:14.706118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-33706b1f-f2f3-43d2-bcce-7f4b16df679a req-d22733e6-e925-4e38-a2d0-a602cc87be66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029181 Jun 17 08:44:14.706705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 353/709] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:15.420787 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-0bc13b6c-fe28-4bbc-bee1-b3d5fcdeae0d req-1c5e04aa-3f80-498d-82fe-abf92c9b05e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "name": "network-vif-plugged", "status": "completed", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:15.429955 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-0bc13b6c-fe28-4bbc-bee1-b3d5fcdeae0d req-1c5e04aa-3f80-498d-82fe-abf92c9b05e1 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.430406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-0bc13b6c-fe28-4bbc-bee1-b3d5fcdeae0d req-1c5e04aa-3f80-498d-82fe-abf92c9b05e1 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.443924 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-0bc13b6c-fe28-4bbc-bee1-b3d5fcdeae0d req-1c5e04aa-3f80-498d-82fe-abf92c9b05e1 service nova] Creating event network-vif-plugged:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:44:15.446082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-0bc13b6c-fe28-4bbc-bee1-b3d5fcdeae0d req-1c5e04aa-3f80-498d-82fe-abf92c9b05e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029036 Jun 17 08:44:15.446663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 357/710] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:44:15.511950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:15.512774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:15.519788 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.520315 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.521183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.521686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.554164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.554634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.555083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lazy-loading 'fault' on Instance uuid b97abb6a-74ab-4810-b2cf-1d17badfa1b8 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:44:15.598782 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4329d95a2764fc58b286f4e1f451b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfca5eaef124207812c35441a729493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:15.606254 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c31356b7-cdcf-4a87-9cd4-17a93aa87003 tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 200 len: 1309 microversion: 2.1 time: 0.100587 Jun 17 08:44:15.606824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 354/711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:15 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:44:15.659574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:15.660279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:15.666821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.667273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.668052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:15.668515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:15.805232 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:15.813462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:15.815028 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:15.816145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-64449e63-5fcc-45dd-b35f-30345b619b49 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.162657 Jun 17 08:44:15.816812 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 358/712] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:15 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:16.623150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:16.623657 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] [instance: b97abb6a-74ab-4810-b2cf-1d17badfa1b8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:16.631083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:16.631527 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:16.632274 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:16.632740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:16.645867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] HTTP exception thrown: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Request method failure captured: Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 HTTP/1.1 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD44wQ8qTLITfquFRfvyMB_P5x87rSxzS7GW7CArM9i8qCoCqqIozEtsXlXYHQE44eiYblYnB8zF669WSHJCO_ZAx90YPNeqo7V36kNfQJp5Q4shuwDwywmLHcgT3ScD3DQnPnjjBIFbnqSSgd0Pqie7oo6W2fyuyqtUtyaKEBou94s Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 8dfca5eaef124207812c35441a729493 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:44:16.647485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dfca5eaef124207812c35441a729493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8dfca5eaef124207812c35441a729493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8dfca5eaef124207812c35441a729493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dfca5eaef124207812c35441a729493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 8dfca5eaef124207812c35441a729493 Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-265746882 Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-VolumesSnapshotTestJSON-265746882-project Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: f4329d95a2764fc58b286f4e1f451b88 Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-VolumesSnapshotTestJSON-265746882-project Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. Jun 17 08:44:16.649104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'b97abb6a-74ab-4810-b2cf-1d17badfa1b8'} Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:44:16.650183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. Jun 17 08:44:16.651641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:44:16.652975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] Returning 404 to user: Instance b97abb6a-74ab-4810-b2cf-1d17badfa1b8 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:44:16.652975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-66857e8d-3728-4260-bf84-4ea9a823ac5b tempest-VolumesSnapshotTestJSON-265746882 tempest-VolumesSnapshotTestJSON-265746882-project] 10.222.0.48 "GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8" status: 404 len: 111 microversion: 2.1 time: 0.029600 Jun 17 08:44:16.652975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 355/713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:44:16 2022] GET /compute/v2.1/servers/b97abb6a-74ab-4810-b2cf-1d17badfa1b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:44:16.834220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:16.834839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:16.841121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:16.841578 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:16.842347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:16.842783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:16.971511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:16.979424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:16.981114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:16.982315 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a27c5468-27b6-4909-b5e4-f5d52874bf48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1407 microversion: 2.20 time: 0.152066 Jun 17 08:44:16.982877 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 359/714] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:16 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:18.001974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:18.002581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:18.009253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:18.009704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:18.010469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:18.010903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:18.144427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:18.152298 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:18.153822 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:44:18.154964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0a6a9596-7ec6-4953-aabb-0c7ec52bf42e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1600 microversion: 2.20 time: 0.157420 Jun 17 08:44:18.155502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 356/715] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:44:17 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:44:18.173350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:44:18.173863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:44:18.180329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:18.180827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:18.181592 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:18.182030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:18.267620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7b9f8316-703d-4f23-ba96-4cb4501fbf5c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098146 Jun 17 08:44:18.268219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 360/716] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 08:44:18 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:44:19.515313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-e6993695-075f-4321-9ecb-7c08f1ceb989 req-43f97069-62c0-4a63-bfaa-ff01bc2d89ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:44:19.525873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-e6993695-075f-4321-9ecb-7c08f1ceb989 req-43f97069-62c0-4a63-bfaa-ff01bc2d89ec service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:44:19.526438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-e6993695-075f-4321-9ecb-7c08f1ceb989 req-43f97069-62c0-4a63-bfaa-ff01bc2d89ec service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:44:19.544425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-e6993695-075f-4321-9ecb-7c08f1ceb989 req-43f97069-62c0-4a63-bfaa-ff01bc2d89ec service nova] Creating event network-changed:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:44:19.549731 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-e6993695-075f-4321-9ecb-7c08f1ceb989 req-43f97069-62c0-4a63-bfaa-ff01bc2d89ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038602 Jun 17 08:44:19.550335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 357/717] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:20.319681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:20.320424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:20.324675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:20.325171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:20.331200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:20.331648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:20.341192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:20.341192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:20.355144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7b378f26-c48d-49d5-b79a-a02184bc3486 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/ips" status: 200 len: 146 microversion: 2.1 time: 0.037637 Jun 17 08:45:20.355700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 361/718] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:45:20 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:25.552227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=51 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:25.552227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=87 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:25.553945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "816abc63-3b6c-45a3-bc6e-f1091a6dcb43"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:25.555082 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:25.561008 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:25.561466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:25.562233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:25.562671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:26.654362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1d951558-e175-4cf7-a108-cc81ba2cbc3d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.108281 Jun 17 08:45:26.655215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 358/719] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:45:25 2022] POST /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 194 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:31.594267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-715739150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2085413800", "security_groups": [{"name": "tempest-secgroup-smoke-1006178609"}], "block_device_mapping_v2": [{"uuid": "77802cc7-9680-4694-b89b-7e9eccb51575", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24510b06-bea9-4fd6-97a7-6277343ccc18"}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:31.709809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] validate_networks() for [('24510b06-bea9-4fd6-97a7-6277343ccc18', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:45:32.077843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:45:32.078272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:45:32.078746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:45:32.079159 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:45:32.079587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:45:32.088919 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:32.089367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:32.090164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:32.090594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:32.107724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:45:32.112416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Getting quotas for user 94d49cbc2d5d458881d3c2a5880f9109 and project b60b9f54cde341cfb2e126fae67e13ef. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:45:32.168576 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:45:32.170637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77802cc7-9680-4694-b89b-7e9eccb51575',volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:45:32.624615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ed54941a-ba98-49b7-9c4a-f93c66e4f84d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.034682 Jun 17 08:45:32.625294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 362/720] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:45:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:45:32.636461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-15d7724c-aced-4b54-8cc0-9c24a249377c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:32.637321 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-15d7724c-aced-4b54-8cc0-9c24a249377c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:32.693130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-15d7724c-aced-4b54-8cc0-9c24a249377c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:32.700078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-15d7724c-aced-4b54-8cc0-9c24a249377c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1094 microversion: 2.1 time: 0.067818 Jun 17 08:45:32.700840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 359/721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:32 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:33.718234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:33.718953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:33.726402 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:33.727618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:33.727618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:33.728025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:33.788055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:33.795519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-711d09b1-b4d6-409f-97b8-e8103ba0b406 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1144 microversion: 2.1 time: 0.081650 Jun 17 08:45:33.801773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 363/722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:33 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:34.811841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:34.812426 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:34.820467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:34.821052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:34.821821 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:34.822293 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:34.895949 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:34.905407 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0817ca30-a883-4002-9c47-f34cd1d0c50c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1200 microversion: 2.1 time: 0.097554 Jun 17 08:45:34.912716 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 360/723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:34 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:35.923230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:35.924127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:35.932535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:35.932989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:35.933777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:35.934216 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:36.278974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:36.286780 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-87ecbf93-b400-40eb-8cef-59797f48f230 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1278 microversion: 2.1 time: 0.367512 Jun 17 08:45:36.287347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 364/724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:35 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:45:36.754066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-d5333aaa-6b4e-4d48-af42-4c4ddcf9eae4 req-dac786fe-ea8c-460d-84db-d1c24bd41d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0daf252-0f9f-4cc0-b4aa-71db216e2ab7", "tag": "2f5da4e4-1c08-4f10-88de-9003f7b0e365"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:36.763299 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-d5333aaa-6b4e-4d48-af42-4c4ddcf9eae4 req-dac786fe-ea8c-460d-84db-d1c24bd41d58 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:36.763897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-d5333aaa-6b4e-4d48-af42-4c4ddcf9eae4 req-dac786fe-ea8c-460d-84db-d1c24bd41d58 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:36.777218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-d5333aaa-6b4e-4d48-af42-4c4ddcf9eae4 req-dac786fe-ea8c-460d-84db-d1c24bd41d58 service nova] Creating event network-changed:2f5da4e4-1c08-4f10-88de-9003f7b0e365 for instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 on hv-cinder-80377 Jun 17 08:45:36.782253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-d5333aaa-6b4e-4d48-af42-4c4ddcf9eae4 req-dac786fe-ea8c-460d-84db-d1c24bd41d58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032396 Jun 17 08:45:36.783050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 361/725] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:37.304365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:37.304999 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:37.311586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:37.312034 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:37.312840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:37.313270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:37.443300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:37.450784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c088e0d0-1773-48f5-ac2a-c6d07e9d22e5 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1278 microversion: 2.1 time: 0.150215 Jun 17 08:45:37.451348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 365/726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:37 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:38.362989 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:38.363974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:38.370141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.370589 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.371347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.371784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.401669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-92bcad1b-479b-4f0a-b650-812460c14ba4 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Jun 17 08:45:38.402247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 362/727] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:45:38 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:38.413403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:38.413895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:38.420449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.420934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.421697 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.422137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.452022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-52245051-5974-4390-ae5b-1e4831b0d8d5 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43" status: 200 len: 194 microversion: 2.1 time: 0.043650 Jun 17 08:45:38.452615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 366/728] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 08:45:38 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:38.467579 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:38.468177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:38.474808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.475255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.476016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:38.476456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:38.661955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:38.669467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aadcd7bd-8311-43cb-8928-beb6d3321b43 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1278 microversion: 2.1 time: 0.205749 Jun 17 08:45:38.670029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 363/729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:38 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:39.686944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:39.687482 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:39.694605 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:39.695053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:39.695813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:39.696247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:39.836443 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:39.843915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2fa938ab-0765-4c27-9bed-f645aabe65f7 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.160927 Jun 17 08:45:39.846155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 367/730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:39 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:40.860391 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:40.861092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:40.868209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:40.868685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:40.869437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:40.869865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:40.998212 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:41.006548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-698b0ecc-1ff9-42e2-b47c-90bdaf631ae4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.149946 Jun 17 08:45:41.007111 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 364/731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:40 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:41.261233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4f53bb1-60f1-4760-a055-31c53cf08112"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:41.262353 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:41.268774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:41.269245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:41.270001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:41.270434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:42.024107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:42.024782 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:42.031278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:42.031735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:42.032560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:42.033005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:42.097725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:42.119311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:42.168096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:42.175684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-843a8c65-1ca9-44a7-b553-bdcc51de52dd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.156416 Jun 17 08:45:42.176280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 365/732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:42 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:45:42.283262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aadd12c9-824d-485d-baa7-4d000eacfdea tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "POST /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025737 Jun 17 08:45:42.283868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 368/733] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:45:41 2022] POST /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:43.191865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:43.192606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:43.194542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:43.199707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:43.200160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:43.200952 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:43.201389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:43.335307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:43.342650 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cb3c4435-3869-4370-bbcc-76f10c7673d8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.154650 Jun 17 08:45:43.343202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 366/734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:43 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:44.361860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:44.362570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:44.370449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:44.370900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:44.371666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:44.372102 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:44.506651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:44.514122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3a360c14-5aa4-4f88-8006-c39349ef7e81 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.157028 Jun 17 08:45:44.514850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 369/735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:44 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:45.530340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:45.530953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:45.537775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:45.538225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:45.538991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:45.539430 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:45.670756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:45.678891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9efa836b-d590-4685-a5f7-9fd71dae6c3e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.152657 Jun 17 08:45:45.683624 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 367/736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:45 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:46.699354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:46.699895 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:46.706440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:46.706892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:46.707653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:46.708095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:46.836116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:46.843588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-766b0891-e53f-4fd7-9b1d-6461f796394e tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.148299 Jun 17 08:45:46.844161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 370/737] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:46 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:47.861151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:47.861870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:47.869361 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:47.869818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:47.870594 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:47.871035 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:48.007890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:48.015374 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b5959e27-08a8-470b-ac1a-e0eae906b32a tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.158166 Jun 17 08:45:48.015946 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 368/738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:47 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:48.220141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:45:48.220363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 08:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:45:49.032785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:49.033407 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:49.040303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:49.041197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:49.041547 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:49.041987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:49.175518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:49.183469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ba99ed82-33d1-4c5c-8b77-bbe17094325f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.154589 Jun 17 08:45:49.184033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 371/739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:49 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:49.617695 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:49.618640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:49.625548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:49.626014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:49.626792 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:49.627230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:49.651103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c2bf7f66-2d67-42ea-a58f-e340a5089055 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/ips" status: 200 len: 153 microversion: 2.20 time: 0.038335 Jun 17 08:45:49.651672 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 369/740] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 08:45:49 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:45:49.867997 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-587e78e2-b17a-4210-a05e-683b32265b39 req-1b33409a-cccc-4723-a66a-d7884421ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0daf252-0f9f-4cc0-b4aa-71db216e2ab7", "name": "network-vif-plugged", "status": "completed", "tag": "2f5da4e4-1c08-4f10-88de-9003f7b0e365"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:49.875982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-587e78e2-b17a-4210-a05e-683b32265b39 req-1b33409a-cccc-4723-a66a-d7884421ae3b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:49.876428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-587e78e2-b17a-4210-a05e-683b32265b39 req-1b33409a-cccc-4723-a66a-d7884421ae3b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:49.887541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-587e78e2-b17a-4210-a05e-683b32265b39 req-1b33409a-cccc-4723-a66a-d7884421ae3b service nova] Creating event network-vif-plugged:2f5da4e4-1c08-4f10-88de-9003f7b0e365 for instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 on hv-cinder-80377 Jun 17 08:45:49.892653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-587e78e2-b17a-4210-a05e-683b32265b39 req-1b33409a-cccc-4723-a66a-d7884421ae3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028986 Jun 17 08:45:49.893286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 372/741] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:50.200303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:50.201286 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:50.207574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:50.209280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:50.210100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:50.210547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:50.393719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:50.402071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9c77294a-8e2f-4496-8c07-603347befd90 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.206350 Jun 17 08:45:50.402629 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 370/742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:50 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:50.849197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:50.850364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:50.857025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:50.857473 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:50.858239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:50.858676 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:50.889448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-74eb9b10-cf19-4efb-9214-65dc003a9aee tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045166 Jun 17 08:45:50.890018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 373/743] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:45:50 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:51.037110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:51.037633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:51.044252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.044866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.045703 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.046153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.077083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1d11c1ca-9f3a-46a5-96e0-1bd7e0db47c0 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43" status: 200 len: 194 microversion: 2.1 time: 0.044533 Jun 17 08:45:51.077666 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 371/744] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 08:45:51 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:51.090308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:51.090900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:51.097141 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.097645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.098597 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.099071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.180984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lazy-loading 'services' on Instance uuid 210115ff-bb3b-4872-877f-1e3330d1218e {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:45:51.420277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:51.420917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:51.427106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.428096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.428943 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:51.429574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:51.490514 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8ede9423-5aa6-4202-b7ac-e206af973a72 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43" status: 202 len: 0 microversion: 2.1 time: 0.404565 Jun 17 08:45:51.491124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 374/745] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:45:51 2022] DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/816abc63-3b6c-45a3-bc6e-f1091a6dcb43 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:45:51.571780 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:51.579470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1538715f-61d9-4176-9f1e-6fa533e76fdd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.163116 Jun 17 08:45:51.579979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 372/746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:51 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:45:52.596043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:52.604789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:52.604789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:52.604789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:52.605211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:52.605608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:52.745774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:52.753693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d5e82e2f-28fc-4fe0-a40d-97e33e71b03d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1266 microversion: 2.1 time: 0.161967 Jun 17 08:45:52.756239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 375/747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:52 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:53.116087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:45:53.117538 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 08:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:45:53.616268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:53.616816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:53.624865 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-7ef43563-9195-415c-825c-2da66bebbe64 req-19758e1e-2ba6-4621-be37-89f9833f1e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:53.633308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7ef43563-9195-415c-825c-2da66bebbe64 req-19758e1e-2ba6-4621-be37-89f9833f1e9a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:53.637053 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:53.637781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7ef43563-9195-415c-825c-2da66bebbe64 req-19758e1e-2ba6-4621-be37-89f9833f1e9a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:53.638499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:53.643317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:53.644272 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:53.655535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-7ef43563-9195-415c-825c-2da66bebbe64 req-19758e1e-2ba6-4621-be37-89f9833f1e9a service nova] Creating event network-changed:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:45:53.661604 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-7ef43563-9195-415c-825c-2da66bebbe64 req-19758e1e-2ba6-4621-be37-89f9833f1e9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039220 Jun 17 08:45:53.662554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 376/748] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:53.673431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:45:53.771872 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:53.773256 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:53.784875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:53.785613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:53.786447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:53.787557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:53.837925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:54.029221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:54.034204 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:54.043470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-034e58b8-72b0-46cc-8b87-98e798dc6f6d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1454 microversion: 2.1 time: 0.275631 Jun 17 08:45:54.059181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 377/749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:53 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1454 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:54.060668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:54.061522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.069037 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.069551 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.070348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.070838 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.090575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-daa599ba-dafb-49c2-8cd8-f708f0aeb551 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "DELETE /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 204 len: 0 microversion: 2.1 time: 0.478545 Jun 17 08:45:54.091302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 373/750] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:45:53 2022] DELETE /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:45:54.095416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lazy-loading 'flavor' on Instance uuid 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:45:54.100729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:54.101164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.107839 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.108299 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.109129 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.109740 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.246251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:54.254080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f7329c41-6d10-438d-8c8f-dc8221155aeb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1454 microversion: 2.1 time: 0.161838 Jun 17 08:45:54.254648 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 374/751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:54 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:54.259329 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:54.259940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.265956 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.266494 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.267320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.267761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.427025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:54.443366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-54e0a337-174a-49db-92b5-5d4adf9a184a tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.187621 Jun 17 08:45:54.444580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 375/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:54 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:54.727505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:54.728051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.734815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.735463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.736259 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.736724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.774519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0ff7737f-b219-4fb0-9493-3663f5570c38 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/d4f53bb1-60f1-4760-a055-31c53cf08112" status: 200 len: 194 microversion: 2.1 time: 0.051651 Jun 17 08:45:54.777876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 376/753] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 08:45:54 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/d4f53bb1-60f1-4760-a055-31c53cf08112 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:45:54.786562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:54.787957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.794584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.795115 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.796051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.796945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.818249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1e57424f-3e8b-42d2-9091-88056da1b98e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/action" status: 202 len: 0 microversion: 2.20 time: 0.761525 Jun 17 08:45:54.822064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 378/754] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 08:45:54 2022] POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:45:54.827660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:54.828356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:54.835734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.836187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.837003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:54.837445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:54.887928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lazy-loading 'services' on Instance uuid 210115ff-bb3b-4872-877f-1e3330d1218e {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:45:54.989782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:54.997901 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:54.999417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:55.000601 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7d3beaf8-19fa-4a32-bcc3-e43db402c3ef tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.177196 Jun 17 08:45:55.001163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 379/755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:45:54 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:55.176964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a1e148a0-3fec-494a-ac31-b29fa987aa80 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/d4f53bb1-60f1-4760-a055-31c53cf08112" status: 202 len: 0 microversion: 2.1 time: 0.395782 Jun 17 08:45:55.182744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 377/756] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:45:54 2022] DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments/d4f53bb1-60f1-4760-a055-31c53cf08112 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:45:55.462553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:55.463189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:55.470467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:55.471259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:55.472187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:55.472843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:55.623674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:55.631881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3df39b37-2712-484c-8fb3-a9dd8a63bff4 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.173831 Jun 17 08:45:55.632413 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 380/757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:55 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:56.020606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:56.021230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:56.023246 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:56.028143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:56.028644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:56.029409 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:56.029846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:56.507871 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:56.518668 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:56.520770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:56.523657 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b2f4aa03-7531-4ff9-af8f-6b52ead3cfbd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.507932 Jun 17 08:45:56.524769 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 378/758] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:45:56 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:45:56.649348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:56.650076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:56.657659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:56.658199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:56.659049 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:56.659487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:56.824684 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:56.833215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3b017c43-06df-4ab4-a251-a93258b1575d tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1567 microversion: 2.1 time: 0.187778 Jun 17 08:45:56.833798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 381/759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:56 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:56.975721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-a997081a-97a5-40d0-b0de-66e2f07370f3 req-f4e84af5-7b59-4ed4-b1fe-d484ffbb328b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0daf252-0f9f-4cc0-b4aa-71db216e2ab7", "tag": "2f5da4e4-1c08-4f10-88de-9003f7b0e365"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:56.983685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-a997081a-97a5-40d0-b0de-66e2f07370f3 req-f4e84af5-7b59-4ed4-b1fe-d484ffbb328b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:56.984131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-a997081a-97a5-40d0-b0de-66e2f07370f3 req-f4e84af5-7b59-4ed4-b1fe-d484ffbb328b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:56.997583 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-a997081a-97a5-40d0-b0de-66e2f07370f3 req-f4e84af5-7b59-4ed4-b1fe-d484ffbb328b service nova] Creating event network-changed:2f5da4e4-1c08-4f10-88de-9003f7b0e365 for instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 on hv-cinder-80377 Jun 17 08:45:57.002796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-a997081a-97a5-40d0-b0de-66e2f07370f3 req-f4e84af5-7b59-4ed4-b1fe-d484ffbb328b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031247 Jun 17 08:45:57.003501 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 379/760] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:45:57.419225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:57.424871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:57.426894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.427345 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.428960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.429403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.461309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7f28cc9f-c765-4664-b16d-162f36ab1963 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046404 Jun 17 08:45:57.462565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 382/761] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:45:57 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:45:57.552266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:57.554118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:57.562413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.563138 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.564084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.564748 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.642444 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:57.643464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:57.651157 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.654097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.654097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.654097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.688704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-58aa61c9-2760-4ee2-9af7-9cfac0ecf365 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050726 Jun 17 08:45:57.693685 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 383/762] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:45:57 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 08:45:57.769519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:57.770067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:57.777242 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.777694 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.778485 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.778919 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.811148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:57.817264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:45:57.824253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:57.826040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:57.827442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1267ed0f-7b57-445e-97dd-7e5d3c9decd7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.280967 Jun 17 08:45:57.828846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 380/763] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:45:57 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:57.854697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:57.855421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:57.861937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.862205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.863079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:57.863700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:57.937783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:57.946325 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-51f34550-e5dc-4df8-98e6-a8ff63fd1307 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1217 microversion: 2.1 time: 0.098814 Jun 17 08:45:57.946914 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 381/764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:57 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:45:58.239451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-418c47a7-5da1-4733-88db-a5113755b0a6 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 204 len: 0 microversion: 2.1 time: 0.473492 Jun 17 08:45:58.241451 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 384/765] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:45:57 2022] DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:45:58.248789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:58.249443 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:58.255505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.256553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.257547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.257987 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.385745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:58.393774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-96946073-ed2f-42b5-9de9-24c8933e4bdd tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1674 microversion: 2.1 time: 0.148853 Jun 17 08:45:58.394336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 382/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:58 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:45:58.847978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:58.848788 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:58.856375 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.856837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.857598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.858027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.963411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:58.964288 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:58.971756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.972284 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.973177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:58.973687 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:58.997939 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:59.006262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:59.006916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:59.007097 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:59.007524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lazy-loading 'fault' on Instance uuid 07227f11-ad68-4c0b-8b4e-f70467ac4894 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:45:59.008765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:59.009636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cdedf827-07fd-4d19-972c-7859ff85c0fd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.166095 Jun 17 08:45:59.010610 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 385/767] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:45:58 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:45:59.021048 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-b19e2ebe-1cc6-40e5-8121-fcbdc5efcde5 req-9ca66f3d-b609-4121-89a2-89f98d301620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07227f11-ad68-4c0b-8b4e-f70467ac4894", "name": "network-vif-deleted", "tag": "e036ee80-5742-426e-a31c-643e355a1e92"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:45:59.029446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b19e2ebe-1cc6-40e5-8121-fcbdc5efcde5 req-9ca66f3d-b609-4121-89a2-89f98d301620 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:59.029892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b19e2ebe-1cc6-40e5-8121-fcbdc5efcde5 req-9ca66f3d-b609-4121-89a2-89f98d301620 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:59.041618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-b19e2ebe-1cc6-40e5-8121-fcbdc5efcde5 req-9ca66f3d-b609-4121-89a2-89f98d301620 service nova] Creating event network-vif-deleted:e036ee80-5742-426e-a31c-643e355a1e92 for instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 on hv-cinder-80377 Jun 17 08:45:59.046352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-b19e2ebe-1cc6-40e5-8121-fcbdc5efcde5 req-9ca66f3d-b609-4121-89a2-89f98d301620 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030866 Jun 17 08:45:59.046943 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 386/768] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:45:59.054830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:59.063191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0fd7cc95-bae7-47c6-aa2c-e477b0fa7af0 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1222 microversion: 2.1 time: 0.103966 Jun 17 08:45:59.063744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 383/769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:58 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:45:59.411883 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:45:59.412619 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:45:59.419438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:59.419893 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:59.420919 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:45:59.421349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:45:59.562353 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:45:59.570381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b10da115-fe5a-426f-ba64-6458bbdd7bfa tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1674 microversion: 2.1 time: 0.162980 Jun 17 08:45:59.570953 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 387/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:45:59 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:00.028147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:00.028812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:00.040652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.041104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.041874 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.042307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.080995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:00.082240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:00.089908 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.090689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.091809 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.092368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.131350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.132531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.133107 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lazy-loading 'fault' on Instance uuid 07227f11-ad68-4c0b-8b4e-f70467ac4894 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:46:00.186814 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2e294be3d7494b80f994c7f58475c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86160ae3ef564baa92ba603c13d0bf5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:00.194851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-01b9403c-7c77-4709-9b1e-1620fcdd6852 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 200 len: 1222 microversion: 2.1 time: 0.117537 Jun 17 08:46:00.200272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 388/771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:00 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:00.234497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:00.245155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:00.246661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:00.247834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-da9eecfb-5695-4b36-a78c-1fd33bc8bdb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.223820 Jun 17 08:46:00.248385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 384/772] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:00 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:00.591059 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:00.591716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:00.598018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.598468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.599518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:00.599956 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:00.827638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:00.835311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4218b201-15c7-4cc7-a6aa-39f80cce738b tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1674 microversion: 2.1 time: 0.248445 Jun 17 08:46:00.849032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 389/773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:00 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:01.213567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:01.214177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] [instance: 07227f11-ad68-4c0b-8b4e-f70467ac4894] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:01.221145 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.221596 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.226257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.226257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.242959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] HTTP exception thrown: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Request method failure captured: Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 HTTP/1.1 Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD22xiVQPWxQhEGaf-ps-wb7bfdcrbpeWSU3rdLqcSxFwaXXvDg4giJYt-W1mKcOAqMNezNy-SQZQCSIwcxV8dHtG-9RQCoKN__lwDP823rc9idzs84Afl2aTsIQi02EC0omfAGyCOhnfcvBOxUpCUZjonRxsmH7NlzRtQX9PQFwl1w Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 86160ae3ef564baa92ba603c13d0bf5b Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-TestShelveInstance-1812077270 Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:46:01.244619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86160ae3ef564baa92ba603c13d0bf5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/86160ae3ef564baa92ba603c13d0bf5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_86160ae3ef564baa92ba603c13d0bf5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86160ae3ef564baa92ba603c13d0bf5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-TestShelveInstance-1812077270 Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 86160ae3ef564baa92ba603c13d0bf5b Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-TestShelveInstance-1812077270 Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-TestShelveInstance-1812077270-project Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 8c2e294be3d7494b80f994c7f58475c8 Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-TestShelveInstance-1812077270-project Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. Jun 17 08:46:01.247078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '07227f11-ad68-4c0b-8b4e-f70467ac4894'} Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:01.249162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. Jun 17 08:46:01.251614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:01.254994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Returning 404 to user: Instance 07227f11-ad68-4c0b-8b4e-f70467ac4894 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:01.254994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1ad955d9-1642-4448-90fb-9347d5102915 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894" status: 404 len: 111 microversion: 2.1 time: 0.037230 Jun 17 08:46:01.254994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 385/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:01 2022] GET /compute/v2.1/servers/07227f11-ad68-4c0b-8b4e-f70467ac4894 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:01.268522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:01.269143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:01.276443 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.277416 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.278414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.279034 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.513172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8b63df73-69b6-47d8-a4d9-e6011d963b21 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] Calling method '.version_select at 0x7ff0250f5a60>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:01.519333 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:01.535104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:01.537015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:01.539621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0159aef4-8cb2-4ed0-a77f-62627e6959f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.275075 Jun 17 08:46:01.540319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 390/775] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:01 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:46:01.632720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8b63df73-69b6-47d8-a4d9-e6011d963b21 tempest-TestShelveInstance-1812077270 tempest-TestShelveInstance-1812077270-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-32527161" status: 202 len: 0 microversion: 2.1 time: 0.121862 Jun 17 08:46:01.635582 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 386/776] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:46:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-32527161 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:46:01.705033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-3a3b39cb-9c64-4115-a56c-1c3e9698c4c1 req-b497feed-6620-4f7b-a0e0-e8ae42854d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210115ff-bb3b-4872-877f-1e3330d1218e", "name": "network-vif-deleted", "tag": "a95437ba-ab43-4e46-898c-2582001bcddd"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:01.714340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-3a3b39cb-9c64-4115-a56c-1c3e9698c4c1 req-b497feed-6620-4f7b-a0e0-e8ae42854d08 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.715106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-3a3b39cb-9c64-4115-a56c-1c3e9698c4c1 req-b497feed-6620-4f7b-a0e0-e8ae42854d08 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.720281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:01.728829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-3a3b39cb-9c64-4115-a56c-1c3e9698c4c1 req-b497feed-6620-4f7b-a0e0-e8ae42854d08 service nova] Creating event network-vif-deleted:a95437ba-ab43-4e46-898c-2582001bcddd for instance 210115ff-bb3b-4872-877f-1e3330d1218e on hv-cinder-80377 Jun 17 08:46:01.734488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-3a3b39cb-9c64-4115-a56c-1c3e9698c4c1 req-b497feed-6620-4f7b-a0e0-e8ae42854d08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Jun 17 08:46:01.738777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 391/777] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:01.852888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:01.853734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:01.860988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.861698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.862988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:01.863591 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:01.941656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32d2a5a83546699f5e2caa3def410d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dacb56069b74ca6b04d4710a9c4bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:01.951721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-19834920-d4e7-4f84-960b-cbef752bbc41 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 200 len: 1323 microversion: 2.1 time: 0.103236 Jun 17 08:46:01.957790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 387/778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:01 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 1323 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:02.562262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:02.565791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:02.567466 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:02.573941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:02.574722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:02.575718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:02.576368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:02.734741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:02.744248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:02.745866 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:02.747137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6f3add65-6bb2-4112-835c-261c710b3b84 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.192030 Jun 17 08:46:02.747678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 392/779] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:02 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:02.970202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:02.976089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:02.980098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:02.980600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:02.981413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:02.981857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:02.998235 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e HTTP/1.1 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:46:02.999787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:03.001584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '210115ff-bb3b-4872-877f-1e3330d1218e'} Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:03.002464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:03.003889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:03.005252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:03.005252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c28f8a8f-f964-404a-b2ec-aa720a4fa79a tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 404 len: 111 microversion: 2.1 time: 0.035030 Jun 17 08:46:03.006186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 388/780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:02 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:03.012846 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b10fe340-7170-4b6d-847e-862d3cef9818 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '.version_select at 0x7ff0250d9790>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:03.139574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b10fe340-7170-4b6d-847e-862d3cef9818 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702987403" status: 202 len: 0 microversion: 2.1 time: 0.131970 Jun 17 08:46:03.140178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 393/781] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 08:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702987403 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 08:46:03.766008 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:03.766615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:03.773867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:03.778242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:03.778242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:03.778242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:03.919166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:03.927357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:03.929038 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:03.930313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6a954ab7-9d18-4d03-abab-efbb629b8ea1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.169374 Jun 17 08:46:03.930953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 389/782] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:03 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:46:04.950499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:04.951902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:04.960085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:04.960790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:04.961620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:04.962062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:05.104876 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:05.114297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:05.116749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:05.118241 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fb943587-e8d9-416c-9b4b-49e19193d230 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.173549 Jun 17 08:46:05.119171 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 394/783] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:04 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:46:06.138459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:06.139071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:06.146196 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.146652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.147460 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.147919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.621505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:06.629807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:06.631707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:06.633055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b9a052e0-ba40-4de8-9cf4-275c867b339c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.498489 Jun 17 08:46:06.633610 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 390/784] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:06 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:06.704884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:06.705687 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:06.712719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.713174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.713965 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.714401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.729002 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e HTTP/1.1 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:46:06.730682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.732076 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '210115ff-bb3b-4872-877f-1e3330d1218e'} Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:06.732870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.734097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.735307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:06.735307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6b2fa1ec-408c-47fa-8a26-be676bbb2736 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 404 len: 111 microversion: 2.1 time: 0.031110 Jun 17 08:46:06.735307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 395/785] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:46:06 2022] DELETE /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:06.741758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:06.742376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 210115ff-bb3b-4872-877f-1e3330d1218e] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:06.748419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.748907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.752166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:06.752166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:06.763659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e HTTP/1.1 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:46:06.765217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.766543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '210115ff-bb3b-4872-877f-1e3330d1218e'} Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:06.767327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. Jun 17 08:46:06.768767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:06.770449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 210115ff-bb3b-4872-877f-1e3330d1218e could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:06.770449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-82308155-a06a-4c1e-8c90-e92e6e8ecb2d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e" status: 404 len: 111 microversion: 2.1 time: 0.028727 Jun 17 08:46:06.770449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 391/786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:06 2022] GET /compute/v2.1/servers/210115ff-bb3b-4872-877f-1e3330d1218e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:07.652365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:07.653484 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:07.665022 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:07.665878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:07.667286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:07.668003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:07.883003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:07.893626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:07.895143 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:07.906052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b6bc1c07-b41e-4e3f-87c4-450257252793 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1746 microversion: 2.20 time: 0.253963 Jun 17 08:46:07.917972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 396/787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:07 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1746 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:08.114109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:08.114725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:08.122451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.123155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.124103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.124917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.140101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c HTTP/1.1 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:46:08.142015 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.143570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '6d680267-4032-4899-9999-bd8fe751264c'} Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:08.144439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.145904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.148883 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:08.150377 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a985ad62-35d2-4a88-b9b8-ee45e408352d tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 404 len: 111 microversion: 2.1 time: 0.039732 Jun 17 08:46:08.151436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 392/788] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:46:08 2022] DELETE /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:46:08.159381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:08.162757 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] [instance: 6d680267-4032-4899-9999-bd8fe751264c] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:08.168202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.168971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.169933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.172545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.187225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] HTTP exception thrown: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Request method failure captured: Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c HTTP/1.1 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirDzjyyDN7dRSgqC29Sgt5ZBjRBUj9y78vMlTabSafqRF3ZaKeRCtOacNAxy0ET7k0h8gDnc-mHu36RqGKV15w8LlcjzTvXwidFYJtYcR3fqY6_-QkBADg70lHcvHrGYfuag06qfeF4BkFIPfoB0j60vjcICuS5w3uvE_atDAT0m0-kw Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:46:08.189548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dacb56069b74ca6b04d4710a9c4bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 5dacb56069b74ca6b04d4710a9c4bc96 Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1639062654 Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: af32d2a5a83546699f5e2caa3def410d Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeTestJSON-1639062654-project Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.191082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '6d680267-4032-4899-9999-bd8fe751264c'} Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:46:08.191967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. Jun 17 08:46:08.193288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:46:08.195400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] Returning 404 to user: Instance 6d680267-4032-4899-9999-bd8fe751264c could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:46:08.196415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-75ec3d5c-d4cb-45ff-8acd-e49177dee587 tempest-AttachVolumeTestJSON-1639062654 tempest-AttachVolumeTestJSON-1639062654-project] 10.222.0.48 "GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c" status: 404 len: 111 microversion: 2.1 time: 0.040998 Jun 17 08:46:08.197474 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 397/789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:08 2022] GET /compute/v2.1/servers/6d680267-4032-4899-9999-bd8fe751264c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:46:08.925615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:08.926535 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:08.933410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.934082 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.935053 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:08.935491 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:08.960107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:09.173014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:09.181021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:09.182522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:09.183759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3d59bb0e-5c77-4669-a1f3-b4057a96e7f4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1746 microversion: 2.20 time: 0.262630 Jun 17 08:46:09.184270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 393/790] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:08 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1746 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:10.024212 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-b5b367a8-2b77-423e-b892-be553ae4692c req-66bfd53e-46a8-4e67-b4b3-28c606372e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "name": "network-vif-plugged", "status": "completed", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:10.034013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b5b367a8-2b77-423e-b892-be553ae4692c req-66bfd53e-46a8-4e67-b4b3-28c606372e51 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:10.034738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b5b367a8-2b77-423e-b892-be553ae4692c req-66bfd53e-46a8-4e67-b4b3-28c606372e51 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:10.051531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-b5b367a8-2b77-423e-b892-be553ae4692c req-66bfd53e-46a8-4e67-b4b3-28c606372e51 service nova] Creating event network-vif-plugged:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:46:10.059471 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-b5b367a8-2b77-423e-b892-be553ae4692c req-66bfd53e-46a8-4e67-b4b3-28c606372e51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039422 Jun 17 08:46:10.060335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 398/791] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:10.205628 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:10.211850 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:10.222587 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:10.223898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:10.225768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:10.226313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:10.377548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:10.386846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:10.398523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:10.398523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b68cd70d-5e5c-4898-8685-9e44e8348b16 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1746 microversion: 2.20 time: 0.191302 Jun 17 08:46:10.398523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 394/792] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:10 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1746 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:11.410149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:11.411703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:11.419325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:11.419777 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:11.420589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:11.421029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:11.561909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:11.570581 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:11.578579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:11.578579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-97d4004b-1515-4a39-804e-1db099cc68e3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1746 microversion: 2.20 time: 0.168375 Jun 17 08:46:11.578579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 399/793] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:11 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:12.593719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:12.595022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:12.604188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:12.605035 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:12.605812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:12.606248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:12.768673 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:12.777240 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:12.778814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:12.779962 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-159303d9-713c-48bd-ac73-683a503b2d5b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1746 microversion: 2.20 time: 0.191004 Jun 17 08:46:12.780735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 395/794] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:12 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:13.799079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:13.799631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:13.806945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:13.807395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:13.808166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:13.808633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:13.970174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:13.979109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:13.980693 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:13.981856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e06367ae-3359-44d0-8f6b-85425cd63cb1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.186858 Jun 17 08:46:13.982411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 400/795] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:13 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:15.001044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:15.002168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:15.009766 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:15.010552 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:15.011702 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:15.012349 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:15.270568 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:15.281422 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:15.283376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:15.284764 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-00cebfb8-ed98-4dff-b10a-3b4ec62a133f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.287570 Jun 17 08:46:15.285507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 396/796] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:14 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:16.305237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:16.305860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:16.321398 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:16.321849 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:16.330792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:16.331252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:16.505726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:16.515774 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:16.517896 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:16.519215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-26b883b1-1b74-4522-8ebb-eddca14d63c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.219517 Jun 17 08:46:16.520218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 401/797] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:16 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:17.542907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:17.543522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:17.553932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:17.554681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:17.555683 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:17.556130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:17.717156 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:17.727369 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:17.729633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:17.730950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f2d2b349-9a16-4343-89a4-7d4df5701325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.191980 Jun 17 08:46:17.742716 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 397/798] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:17 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:18.751307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:18.751872 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:18.768872 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:18.769328 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:18.770118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:18.770687 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:19.016706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:19.039061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:19.042542 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:19.048071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-efeff05a-30c1-4601-8cc0-635250373697 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.298165 Jun 17 08:46:19.052715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 402/799] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:18 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:20.066377 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:20.066986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:20.078089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:20.079011 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:20.080208 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:20.080761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:20.309796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:20.326722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:20.331145 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:20.334848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-940b82f0-8094-4d7b-9700-587ca4352e2d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.271704 Jun 17 08:46:20.336696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 398/800] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:20 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:21.358415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:21.366470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:21.374618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:21.375350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:21.376428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:21.377149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:21.747664 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:21.756801 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:21.758752 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:21.760065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-80e7629a-bef1-4a68-933a-53f22119c639 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.407198 Jun 17 08:46:21.760726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 403/801] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:21 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:22.033529 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8e2c19ba-50ce-4ae9-a73d-ce8e38cd19aa tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: .version_select at 0x7ff0251380d0>, body: {"keypair": {"name": "tempest-keypair-2073759617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXvNGZiBf6L2iUNP1lYinNWvv+/8fhpxPPKkW4qCL4BIN7OW8xU3RfEUJbD2qeW5aIMSdilGd4Hd7qF2Zzwru6kNzA8R1XZho7v8kURivdTntvIq8zFEWE+7xEbQFrOVg=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:22.050444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-8e2c19ba-50ce-4ae9-a73d-ce8e38cd19aa tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:46:22.055587 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-8e2c19ba-50ce-4ae9-a73d-ce8e38cd19aa tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:46:22.213637 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8e2c19ba-50ce-4ae9-a73d-ce8e38cd19aa tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306812 Jun 17 08:46:22.213637 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 399/802] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:46:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:22.784990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:22.787869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:22.796348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:22.801596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:22.801596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:22.801596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:23.001417 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:23.019823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:23.023029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:23.025240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6ca324aa-2d0d-4c43-9f99-75cc314136b7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.245554 Jun 17 08:46:23.029115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 404/803] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:22 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:24.050732 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:24.051940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:24.071519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:24.072287 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:24.073316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:24.073923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:24.580134 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:24.595462 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:24.597984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:24.599213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8a611101-8b08-4ac7-a4bf-4c9cec9def6c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.556055 Jun 17 08:46:24.600756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 400/804] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:24 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:25.600392 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1778799689", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09b364a3-a026-409b-a21c-0c0c53a97d24"}], "security_groups": [{"name": "tempest-securitygroup--25744209"}], "key_name": "tempest-keypair-2073759617", "user_data": "}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:25.623468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:25.624742 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:25.648383 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:25.648871 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:25.649666 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:25.650106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:25.822837 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] validate_networks() for [('09b364a3-a026-409b-a21c-0c0c53a97d24', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:46:25.887681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:25.897207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:25.903128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:25.904413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-008623e3-1715-468c-9e75-a9cd5bedaa7d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.284935 Jun 17 08:46:25.905004 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 401/805] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:25 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:46:26.266596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:46:26.267017 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:46:26.267497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:46:26.267902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:46:26.268309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:46:26.277845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:26.278289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:26.279081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:26.279517 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:26.299760 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:46:26.306927 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:46:26.322696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:46:26.326922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:46:26.556051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f8a8ea76-d5d7-4eb8-9ae5-c38cccc1bc83 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.961724 Jun 17 08:46:26.557386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 405/806] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:46:25 2022] POST /compute/v2.1/servers => generated 400 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:46:26.568452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4165ca67-55bc-43dc-9361-f3a5b6e40b9f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:26.573264 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4165ca67-55bc-43dc-9361-f3a5b6e40b9f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:26.575346 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:26.689461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4165ca67-55bc-43dc-9361-f3a5b6e40b9f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:26.701494 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4165ca67-55bc-43dc-9361-f3a5b6e40b9f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1242 microversion: 2.1 time: 0.133989 Jun 17 08:46:26.712063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 402/807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:26 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:26.923941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:26.924578 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:26.931834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:26.933211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:26.933487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:26.934112 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:27.082373 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:27.084509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:27.086018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:27.087179 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e448dec5-56d1-4955-98e9-cb14537c5806 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.167866 Jun 17 08:46:27.087735 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 406/808] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:26 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:27.719465 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7d5ef35d-9e6f-4169-8154-0d039925b263 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:27.720075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7d5ef35d-9e6f-4169-8154-0d039925b263 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:27.777094 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7d5ef35d-9e6f-4169-8154-0d039925b263 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:27.783953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7d5ef35d-9e6f-4169-8154-0d039925b263 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1242 microversion: 2.1 time: 0.068417 Jun 17 08:46:27.784534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 403/809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:27 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:28.105431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:28.106071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:28.112721 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:28.113142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:28.113904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:28.114337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:28.241982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:28.249922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:28.255579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:28.255579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4b093815-1c57-41f4-968f-d57d687f1d81 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1741 microversion: 2.20 time: 0.151214 Jun 17 08:46:28.255579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 407/810] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:28 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:28.801662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:28.802382 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:28.810115 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:28.810908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:28.811790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:28.812294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:28.908229 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:28.917720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aa369806-e956-4fc8-9ad0-0a17feefdc48 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1238 microversion: 2.1 time: 0.119741 Jun 17 08:46:28.918306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 404/811] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:28 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:29.277396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:29.277966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:29.285030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:29.285484 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:29.290409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:29.290409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:29.499203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:29.521655 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:29.523938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:29.525468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d0b647b3-1242-403b-baa3-914c50329131 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1723 microversion: 2.20 time: 0.253405 Jun 17 08:46:29.527720 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 408/812] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:29 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:29.934746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:29.935366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:29.941784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:29.942233 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:29.942995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:29.943430 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:30.005931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:30.014003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f78bc49e-d7d7-4687-b521-fe0dbf3b9e43 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1312 microversion: 2.1 time: 0.083177 Jun 17 08:46:30.014567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 405/813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:29 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1312 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:30.543810 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:30.544427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:30.551016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:30.551469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:30.552259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:30.552729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:30.684139 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:30.692033 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:30.693629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:30.694697 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4c88344c-8390-4e40-8300-b5f02d0996d8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1723 microversion: 2.20 time: 0.154881 Jun 17 08:46:30.695709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 409/814] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:30 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:31.031272 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:31.031893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:31.038968 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.039580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.040436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.040897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.105135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:31.112447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-063188e4-d8d6-4569-bf33-82b37fa33614 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1312 microversion: 2.1 time: 0.085169 Jun 17 08:46:31.113036 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 406/815] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:31 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:31.714807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:31.715981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:31.727501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.727501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.727501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.727982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.822484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-6d055af2-6b51-45ef-8ba7-93f48bf109d1 req-412a0e94-f18a-441e-9eb3-c469586e35ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "name": "network-vif-unplugged", "status": "completed", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:31.832855 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-6d055af2-6b51-45ef-8ba7-93f48bf109d1 req-412a0e94-f18a-441e-9eb3-c469586e35ac service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.833307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-6d055af2-6b51-45ef-8ba7-93f48bf109d1 req-412a0e94-f18a-441e-9eb3-c469586e35ac service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.845505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-6d055af2-6b51-45ef-8ba7-93f48bf109d1 req-412a0e94-f18a-441e-9eb3-c469586e35ac service nova] Creating event network-vif-unplugged:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:46:31.851128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-6d055af2-6b51-45ef-8ba7-93f48bf109d1 req-412a0e94-f18a-441e-9eb3-c469586e35ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033539 Jun 17 08:46:31.852279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 407/816] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:46:31.875656 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:31.884185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:31.888084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:31.888084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3eb77407-694b-4004-98cb-71fb31a8ee10 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1726 microversion: 2.20 time: 0.176698 Jun 17 08:46:31.888084 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 410/817] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:31 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:31.905916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4588e84b-35c5-4bda-817e-1cfb821b5337"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:31.921102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:31.921102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.921102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:31.921102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:31.922204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:32.130347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:32.131404 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:32.141252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:32.141750 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:32.142524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:32.142966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:32.282432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:32.290842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4f086cda-348b-40b1-871c-60d2e13b116c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.164718 Jun 17 08:46:32.291414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 411/818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:32 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:32.811062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-13756f71-4a2e-4a85-92eb-e050c9e2718d req-8b2887cd-b33b-4d18-ad72-97b863d2ad2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e311d6c-6487-46f7-a413-b07f95d91018", "tag": "fbdbedab-420f-4297-9abe-ffb6d7f1ac0e"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:32.819884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-13756f71-4a2e-4a85-92eb-e050c9e2718d req-8b2887cd-b33b-4d18-ad72-97b863d2ad2d service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:32.821542 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-13756f71-4a2e-4a85-92eb-e050c9e2718d req-8b2887cd-b33b-4d18-ad72-97b863d2ad2d service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:32.825894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:32.837206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-13756f71-4a2e-4a85-92eb-e050c9e2718d req-8b2887cd-b33b-4d18-ad72-97b863d2ad2d service nova] Creating event network-changed:fbdbedab-420f-4297-9abe-ffb6d7f1ac0e for instance 0e311d6c-6487-46f7-a413-b07f95d91018 on hv-cinder-80377 Jun 17 08:46:32.843097 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-13756f71-4a2e-4a85-92eb-e050c9e2718d req-8b2887cd-b33b-4d18-ad72-97b863d2ad2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037105 Jun 17 08:46:32.843839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 412/819] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:33.166640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bd0eed18-b093-4efe-aa94-febdda395358 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.265098 Jun 17 08:46:33.172024 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 408/820] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 08:46:31 2022] POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 188 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:46:33.285243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:33.285891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:33.293632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.294081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.294845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.295280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.308124 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:33.308798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:33.314955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.315416 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.316258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.316724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.455318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:33.462857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b5a1d87d-e757-47d5-a287-9ef96df06aea tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.159621 Jun 17 08:46:33.463427 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 409/821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:33 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:46:33.568389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-88b9a3ea-bdf5-4e71-a72f-d84698cd217d tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/action" status: 202 len: 0 microversion: 2.20 time: 0.287513 Jun 17 08:46:33.569546 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 413/822] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 08:46:33 2022] POST /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:46:33.577629 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:33.578244 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:33.584511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.585254 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.586593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:33.587068 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:33.719406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:33.728334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:33.729882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:33.731052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4e45ddef-f0db-4fbc-a2e4-b13c5f05164c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1752 microversion: 2.20 time: 0.157493 Jun 17 08:46:33.731604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 410/823] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:33 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:34.480206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:34.480850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:34.486926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:34.487369 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:34.488123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:34.488585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:34.620543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:34.627898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cd0ca1e4-452a-4eff-9e2a-925f7242e954 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.152321 Jun 17 08:46:34.628463 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 414/824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:34 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:34.750907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:34.751516 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:34.758507 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:34.758957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:34.759745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:34.760209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:34.764428 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:34.892221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:34.900853 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:34.902389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:34.903567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e7797f00-6da0-44cd-b866-ad5753372019 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1752 microversion: 2.20 time: 0.156944 Jun 17 08:46:34.904118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 411/825] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:34 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:35.645424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:35.646038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:35.649114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:35.653992 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:35.654442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:35.655207 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:35.655640 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:35.786798 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:35.794742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cb6656a6-cd58-40a9-99bc-a4aa300f7805 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.153100 Jun 17 08:46:35.795369 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 415/826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:35 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:35.922976 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:35.928337 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:35.930929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:35.931384 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:35.932163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:35.932604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:36.065080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:36.073995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:36.075498 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:36.076684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ebb88081-999d-4f77-9a9e-489467f1bcc4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1752 microversion: 2.20 time: 0.157963 Jun 17 08:46:36.077245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 412/827] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:35 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:36.811881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:36.812464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:36.814388 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:36.815106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:36.820797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:36.821255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:36.822025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:36.822462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:36.956427 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:36.964400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0e04bd57-26b5-471a-b960-e1595b0d757c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.156658 Jun 17 08:46:36.964988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 416/828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:36 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:37.095040 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:37.095675 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:37.102155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:37.102605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:37.103376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:37.103814 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:37.234543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:37.243296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:37.244912 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:37.246063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2ee3eb68-b45b-4ac2-8eb5-2f90046110aa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1754 microversion: 2.20 time: 0.154959 Jun 17 08:46:37.246614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 413/829] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:37 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:37.968963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-ab73ab3d-b771-4bea-a566-bb3a500f2eb6 req-981cc4d4-47c2-45a2-a7ba-e16583ff6e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e311d6c-6487-46f7-a413-b07f95d91018", "name": "network-vif-plugged", "status": "completed", "tag": "fbdbedab-420f-4297-9abe-ffb6d7f1ac0e"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:37.977829 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ab73ab3d-b771-4bea-a566-bb3a500f2eb6 req-981cc4d4-47c2-45a2-a7ba-e16583ff6e35 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:37.978271 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ab73ab3d-b771-4bea-a566-bb3a500f2eb6 req-981cc4d4-47c2-45a2-a7ba-e16583ff6e35 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:37.982556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:37.983174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:37.985344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=8 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:37.989303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-ab73ab3d-b771-4bea-a566-bb3a500f2eb6 req-981cc4d4-47c2-45a2-a7ba-e16583ff6e35 service nova] Creating event network-vif-plugged:fbdbedab-420f-4297-9abe-ffb6d7f1ac0e for instance 0e311d6c-6487-46f7-a413-b07f95d91018 on hv-cinder-80377 Jun 17 08:46:37.990182 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:37.990636 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:37.991404 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:37.992452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:37.994869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-ab73ab3d-b771-4bea-a566-bb3a500f2eb6 req-981cc4d4-47c2-45a2-a7ba-e16583ff6e35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029653 Jun 17 08:46:37.995461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 417/830] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:38.145594 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:38.154995 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f90ccef1-4bf5-458b-a001-220c93024d54 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.176069 Jun 17 08:46:38.155641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 414/831] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:37 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:46:38.264645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:38.265282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:38.271587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:38.272030 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:38.272820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:38.273934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:38.465083 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:38.475828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:38.478343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:38.479521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ef1be373-7abd-4999-a215-b1c06b66e9b4 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.219514 Jun 17 08:46:38.480098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 418/832] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:38 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:39.173153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:39.173725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:39.181316 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:39.181773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:39.182574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:39.183194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:39.311964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:39.319424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-00578d7b-c2be-4b95-8749-a253ee3ffe1d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1366 microversion: 2.1 time: 0.150270 Jun 17 08:46:39.320075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 415/833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:39 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:39.497773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:39.498302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:39.504772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:39.505219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:39.505981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:39.506414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:39.637761 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:39.646025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:39.647503 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:39.649201 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-54ceb585-d1cb-4594-9b76-163c17eb3459 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.155617 Jun 17 08:46:39.649750 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 419/834] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:39 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:40.342504 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:40.344674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:40.356834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.357490 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.358394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.358868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.513440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:40.521410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-55e37532-1907-4967-a989-01f7033c49ef tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1556 microversion: 2.1 time: 0.187940 Jun 17 08:46:40.531366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 416/835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:46:40 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:46:40.540129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:40.540839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:40.548435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.549240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.550156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.550713 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.657576 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f560db28-8760-48d0-9d6e-5d99687c1754 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122627 Jun 17 08:46:40.658926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 420/836] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:46:40 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:46:40.668619 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:40.669548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:40.679266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.680340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.681459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:40.682106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:40.862443 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:40.871809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:40.873456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:40.874532 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-20c98c38-4a2c-4b46-932a-3c83be5cf701 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.211039 Jun 17 08:46:40.886373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 417/837] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:40 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:41.894293 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:41.894951 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:41.902495 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:41.904055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:41.905529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:41.907908 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:41.948785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-4a9bfba1-40a8-4608-8b41-48d4ae99f876 req-e7330731-f434-4f91-9c6f-4ab12adb303b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e311d6c-6487-46f7-a413-b07f95d91018", "tag": "fbdbedab-420f-4297-9abe-ffb6d7f1ac0e"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:46:41.958289 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-4a9bfba1-40a8-4608-8b41-48d4ae99f876 req-e7330731-f434-4f91-9c6f-4ab12adb303b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:41.958899 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-4a9bfba1-40a8-4608-8b41-48d4ae99f876 req-e7330731-f434-4f91-9c6f-4ab12adb303b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:41.973313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-4a9bfba1-40a8-4608-8b41-48d4ae99f876 req-e7330731-f434-4f91-9c6f-4ab12adb303b service nova] Creating event network-changed:fbdbedab-420f-4297-9abe-ffb6d7f1ac0e for instance 0e311d6c-6487-46f7-a413-b07f95d91018 on hv-cinder-80377 Jun 17 08:46:41.978674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-4a9bfba1-40a8-4608-8b41-48d4ae99f876 req-e7330731-f434-4f91-9c6f-4ab12adb303b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034401 Jun 17 08:46:41.979356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 418/838] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:46:42.051135 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:42.060713 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:42.062426 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:42.063590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9d5aab9f-fbf7-46c2-9414-1ec966a9effa tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.173896 Jun 17 08:46:42.064157 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 421/839] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:41 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:43.088181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:43.089308 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:43.095706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:43.096390 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:43.097188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:43.097632 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:43.254502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:43.264734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:43.266248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:43.267447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0153907d-95c3-4269-afe1-6448749a5449 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.184490 Jun 17 08:46:43.267999 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 419/840] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:43 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:44.287082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:44.287681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:44.295795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:44.296401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:44.297249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:44.297784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:44.441354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:44.452062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:44.454898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:44.456888 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fbfcf83c-5bf8-4e4d-b9e7-4e78baca244b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.173717 Jun 17 08:46:44.457934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 422/841] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:44 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:45.477116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:45.477719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:45.484183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:45.484658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:45.485417 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:45.485847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:45.619635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:45.628368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:45.629935 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:45.631101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e3f8975b-c377-475e-af64-a58874a71bbb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.158570 Jun 17 08:46:45.631691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 420/842] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:45 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:46.650765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:46.651355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:46.657530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:46.657962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:46.658708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:46.659136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:46.827180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:46.836672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:46.837871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:46.839044 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4e7b287e-81fe-4cff-83dd-ffb20d0cb083 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.193172 Jun 17 08:46:46.839799 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 423/843] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:46 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:47.858404 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:47.859195 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:47.866101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:47.866863 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:47.867983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:47.868436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:48.025110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:48.034396 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:48.036074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:48.037703 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-945b1aef-6af7-4fe7-9ffe-380f442dc0fc tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.183729 Jun 17 08:46:48.038389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 421/844] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:47 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:49.057588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:49.058184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:49.064778 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:49.065229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:49.065988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:49.066422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:49.216045 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:49.225296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:49.227333 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:49.228594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dc2c35a3-0bf5-4537-9cb7-a2e015b8fd64 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.175657 Jun 17 08:46:49.239267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 424/845] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:49 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:50.247832 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:50.248345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:50.254967 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:50.256065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:50.256296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:50.256753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:50.397004 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:50.405375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:50.406865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:50.408043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4d4f2611-4d16-42a4-8c9b-8bb3e5430264 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.164187 Jun 17 08:46:50.408624 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 422/846] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:50 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:51.427349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:51.427957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:51.434536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:51.434984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:51.435740 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:51.436174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:51.566392 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:51.575816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:51.577353 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:51.578512 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d942baf9-a8f2-42b6-ad66-a1061852cb0c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.155139 Jun 17 08:46:51.579067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 425/847] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:51 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:52.597601 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:52.598209 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:52.605725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:52.606182 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:52.606948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:52.607391 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:52.738061 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:52.746641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:52.748137 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:52.749320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-036c33ee-cb54-467e-8ea7-99e70933f40a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.155593 Jun 17 08:46:52.749870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 423/848] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:52 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:53.768250 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:53.768891 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:53.775543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:53.775995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:53.776796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:53.777236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:53.905127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:53.914900 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:53.916447 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:53.917705 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a355a600-eb72-4800-a992-42f10fd42c06 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.153409 Jun 17 08:46:53.918260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 426/849] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:53 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:54.936280 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:54.936921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:54.943402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:54.943855 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:54.945291 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:54.945828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:55.075464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:55.083825 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:55.085806 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:55.086961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-52d5342b-8fd8-45f8-96f5-a92597668b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.154651 Jun 17 08:46:55.087515 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 424/850] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:54 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:56.105596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:56.106857 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:56.113549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:56.113996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:56.115088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:56.115542 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:56.264558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:56.274092 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:56.283090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:56.283090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a759fca7-0951-4356-9fc5-8c374aae158f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.175319 Jun 17 08:46:56.283090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 427/851] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:56 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:57.295849 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:57.296528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:57.305471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:57.305471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:57.305471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:57.305471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:57.431599 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:57.440033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:57.441553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:57.442705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-faf7aa14-2402-435a-b3d5-7a1860b2ea2c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.150855 Jun 17 08:46:57.443260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 425/852] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:57 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:58.461111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:58.461731 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:58.468249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:58.468740 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:58.469501 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:58.469938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:58.600431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:58.608827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:58.610335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:58.611497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6de47996-a28e-4cb0-9f7b-66c27a9d224b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.154387 Jun 17 08:46:58.612053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 428/853] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:58 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:46:59.630256 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:46:59.630870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:46:59.633921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=52 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:59.638650 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:59.639104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:59.639868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:46:59.640307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:46:59.767290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:59.775602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:59.777147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:46:59.778301 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c8de4e4d-ac7c-4502-b6ef-b25ea0630f1c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.151931 Jun 17 08:46:59.778850 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 426/854] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:46:59 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:00.797621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:00.798223 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:00.805648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:00.806090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:00.806851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:00.807280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:00.825622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:00.934675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:00.942898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:00.944395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:00.946132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-56ef26d6-260b-43cf-b201-94f78c7c75c1 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.152562 Jun 17 08:47:00.946681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 429/855] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:00 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:01.964993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:01.965672 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:01.972068 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:01.972544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:01.973310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:01.973748 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:02.110380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:02.118777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:02.120294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:02.121497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-62581957-ad01-4ff9-9641-baddd923bae5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.160985 Jun 17 08:47:02.122055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 427/856] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:01 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:03.140111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:03.140753 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:03.147490 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:03.147994 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:03.149147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:03.149579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:03.311134 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:03.320206 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:03.321881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:03.323388 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7d70dc72-c1ea-4bf5-bc19-40daedba0d29 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.187336 Jun 17 08:47:03.324293 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 430/857] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:03 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:04.038502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-e1ece491-5115-46c1-8894-4f4c3b8dbf6d req-8972468c-130e-427d-a35e-71e8d485292e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "name": "network-vif-plugged", "status": "completed", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:47:04.049159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-e1ece491-5115-46c1-8894-4f4c3b8dbf6d req-8972468c-130e-427d-a35e-71e8d485292e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:04.049607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-e1ece491-5115-46c1-8894-4f4c3b8dbf6d req-8972468c-130e-427d-a35e-71e8d485292e service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:04.062058 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-e1ece491-5115-46c1-8894-4f4c3b8dbf6d req-8972468c-130e-427d-a35e-71e8d485292e service nova] Creating event network-vif-plugged:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:47:04.067188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-e1ece491-5115-46c1-8894-4f4c3b8dbf6d req-8972468c-130e-427d-a35e-71e8d485292e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087846 Jun 17 08:47:04.067776 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 428/858] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:47:04.342915 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:04.343488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:04.350062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:04.350508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:04.351659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:04.352089 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:04.486115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:04.495055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:04.496580 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:04.497734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-836cf120-23fc-4159-aa5b-fbaf999a2080 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.158897 Jun 17 08:47:04.498293 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 431/859] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:04 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:05.517365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:05.518063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:05.525451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:05.525907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:05.526673 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:05.527114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:05.531055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=100 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:05.655638 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:05.664681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:05.666263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:05.667408 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-975b4d01-963a-4806-b360-e3f88601d238 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.154338 Jun 17 08:47:05.667955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 429/860] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:05 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:06.685904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:06.686520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:06.688892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=34 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:06.693785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:06.694229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:06.695483 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:06.695916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:06.978632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:06.987260 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:06.988847 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:06.990008 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5107b6eb-9afb-42bd-abc2-b1dc5f40c9e6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.308016 Jun 17 08:47:06.990564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 432/861] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:06 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:08.008874 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:08.009489 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:08.016023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:08.016475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:08.017335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:08.017701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:08.148806 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:08.157420 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:08.158931 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:08.160091 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6b47e0f9-83ed-4a8f-ab61-2782c7a8784f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1810 microversion: 2.20 time: 0.155279 Jun 17 08:47:08.160674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 430/862] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:08 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:09.181892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:09.182606 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:09.189029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:09.189470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:09.190223 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:09.190651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:09.321881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:09.330163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:09.331674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:09.332841 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-44a1a30a-db45-4083-9ece-98fe2a498247 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1797 microversion: 2.20 time: 0.156298 Jun 17 08:47:09.333434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 433/863] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:47:09 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1797 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:47:57.755651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:57.756211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:57.758080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.758988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=9 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.759461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=10 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.759592 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=26 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.764870 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:57.769947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:57.769947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:57.769947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:57.796171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:47:57.896587 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-3d805a44-1127-4577-a823-a3df72f8c999 req-557c8400-5dc7-4905-919a-e4d081a1ffc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0daf252-0f9f-4cc0-b4aa-71db216e2ab7", "tag": "2f5da4e4-1c08-4f10-88de-9003f7b0e365"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:47:57.906535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-3d805a44-1127-4577-a823-a3df72f8c999 req-557c8400-5dc7-4905-919a-e4d081a1ffc9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:57.907704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-3d805a44-1127-4577-a823-a3df72f8c999 req-557c8400-5dc7-4905-919a-e4d081a1ffc9 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:57.920862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-3d805a44-1127-4577-a823-a3df72f8c999 req-557c8400-5dc7-4905-919a-e4d081a1ffc9 service nova] Creating event network-changed:2f5da4e4-1c08-4f10-88de-9003f7b0e365 for instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 on hv-cinder-80377 Jun 17 08:47:57.927212 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-3d805a44-1127-4577-a823-a3df72f8c999 req-557c8400-5dc7-4905-919a-e4d081a1ffc9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174563 Jun 17 08:47:57.928189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 434/864] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:47:58.298924 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bc4767d4-56f6-42c8-8eb9-04d6a811f56b tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 204 len: 0 microversion: 2.1 time: 0.547852 Jun 17 08:47:58.299953 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 431/865] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:47:57 2022] DELETE /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:47:58.308468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:58.309281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:58.316328 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:58.316808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:58.317579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:58.318010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:58.354224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:58.354798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:58.363343 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:58.364081 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:58.364565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:58.364998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:58.393095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-37db3588-6558-44a6-9b38-7d988b587a0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/ips" status: 200 len: 150 microversion: 2.1 time: 0.041919 Jun 17 08:47:58.393887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 432/866] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:47:58 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:47:58.552815 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:58.560791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aba3fec6-702d-422b-83d7-23695f3c736f tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1579 microversion: 2.1 time: 0.256465 Jun 17 08:47:58.561368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 435/867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:47:58 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1579 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:47:59.578630 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:47:59.579163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:47:59.585941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:59.586392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:59.587150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:47:59.587586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:47:59.722476 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:47:59.730029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-47cebafe-9b43-468e-9437-de93fd4eb547 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1579 microversion: 2.1 time: 0.155458 Jun 17 08:47:59.730585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 433/868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:47:59 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:00.752382 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:00.753026 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:00.760284 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:00.760954 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:00.762102 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:00.762665 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:00.811637 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-9444a708-3a2f-408a-9829-b4a5d0f77ff3 req-3a050dec-fc0d-4b15-8a38-639fb9b07253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0daf252-0f9f-4cc0-b4aa-71db216e2ab7", "name": "network-vif-deleted", "tag": "2f5da4e4-1c08-4f10-88de-9003f7b0e365"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:00.821460 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-9444a708-3a2f-408a-9829-b4a5d0f77ff3 req-3a050dec-fc0d-4b15-8a38-639fb9b07253 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:00.826711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-9444a708-3a2f-408a-9829-b4a5d0f77ff3 req-3a050dec-fc0d-4b15-8a38-639fb9b07253 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:00.833269 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-9444a708-3a2f-408a-9829-b4a5d0f77ff3 req-3a050dec-fc0d-4b15-8a38-639fb9b07253 service nova] Creating event network-vif-deleted:2f5da4e4-1c08-4f10-88de-9003f7b0e365 for instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 on hv-cinder-80377 Jun 17 08:48:00.838487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-9444a708-3a2f-408a-9829-b4a5d0f77ff3 req-3a050dec-fc0d-4b15-8a38-639fb9b07253 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 Jun 17 08:48:00.839087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 434/869] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:48:00.839629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:00.847616 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-998958cb-987e-49e4-acf2-3b972607006d tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1392 microversion: 2.1 time: 0.100082 Jun 17 08:48:00.848167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 436/870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:00 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1392 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:01.243083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7f33af8-1090-4c5b-8946-6b4dcf5af5a1"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:01.244262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:01.250604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:01.251044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:01.252915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:01.253352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:01.865394 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:01.866095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:01.872958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:01.873411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:01.874177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:01.874611 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:01.906627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:01.907174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:01.918210 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lazy-loading 'fault' on Instance uuid c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:48:01.951133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:01.963840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-831bef43-b226-46bf-8942-b2ef6681316c tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 200 len: 1230 microversion: 2.1 time: 0.098238 Jun 17 08:48:01.963840 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 437/871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:01 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:48:02.359701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-611b236e-1ca0-4554-9738-948dfa8f8aa9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.120510 Jun 17 08:48:02.363448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 435/872] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:48:01 2022] POST /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments => generated 194 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:02.978674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:02.979748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: c0daf252-0f9f-4cc0-b4aa-71db216e2ab7] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:02.989162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:02.989624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:02.990558 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:02.991330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:03.007597 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] HTTP exception thrown: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Request method failure captured: Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 HTTP/1.1 Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD1kPfLyzF6yv-3ZrH-dhQM22uWWBA3QJCdxUSg5J6HfB7BYrZvcH_r1hsiU_ggADrX8rpR_sEsQS5iZNAMyjcCtSekjv-1oP9w8hGWIhGhxi1dFAPXPeFUcTIVvp6mB0WnGKszRv3Haf0blEnxxfiM0wGWz9BzKTJRICm1mGTU8S1Y Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:48:03.009565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 94d49cbc2d5d458881d3c2a5880f9109 Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. Jun 17 08:48:03.011291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'c0daf252-0f9f-4cc0-b4aa-71db216e2ab7'} Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:48:03.012181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. Jun 17 08:48:03.013819 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:03.015199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Returning 404 to user: Instance c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:48:03.015199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5f91b9ce-3177-4fef-b097-18ff13196635 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7" status: 404 len: 111 microversion: 2.1 time: 0.038010 Jun 17 08:48:03.015199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 438/873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:02 2022] GET /compute/v2.1/servers/c0daf252-0f9f-4cc0-b4aa-71db216e2ab7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:48:05.463326 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:05.463924 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:05.471569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.472045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:05.472835 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.473266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:05.503580 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-768fffb6-23aa-40f2-bcf4-075768ee9647 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments/4588e84b-35c5-4bda-817e-1cfb821b5337" status: 200 len: 194 microversion: 2.20 time: 0.044079 Jun 17 08:48:05.504144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 436/874] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jun 17 08:48:05 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments/4588e84b-35c5-4bda-817e-1cfb821b5337 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:48:05.588198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:05.588800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:05.595554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.596069 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:05.596879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.597316 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:05.683588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lazy-loading 'services' on Instance uuid 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:48:05.955055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7333302d-efed-42e4-9096-604ead9bd20f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments/4588e84b-35c5-4bda-817e-1cfb821b5337" status: 202 len: 0 microversion: 2.20 time: 0.370476 Jun 17 08:48:05.956432 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 439/875] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 08:48:05 2022] DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments/4588e84b-35c5-4bda-817e-1cfb821b5337 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:48:05.964444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:05.965411 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:05.972667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.973063 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:05.973840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:05.974281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:06.006672 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8f49345e-0090-4260-8661-8441d6255265 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046287 Jun 17 08:48:06.007221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 437/876] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:05 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:48:06.529928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:06.531208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:06.538904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:06.539622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:06.540419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:06.542006 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:06.572016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:48:06.634327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-39859b1c-f0cf-4095-ad12-22a326144b30 req-a3722c59-3f29-4fb8-83ee-7e22e744631c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9c12f0-3345-45e1-bfad-670023235180", "tag": "0b636c68-8977-4624-b852-695f70fcb969"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:06.643525 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-39859b1c-f0cf-4095-ad12-22a326144b30 req-a3722c59-3f29-4fb8-83ee-7e22e744631c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:06.644236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-39859b1c-f0cf-4095-ad12-22a326144b30 req-a3722c59-3f29-4fb8-83ee-7e22e744631c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:06.655986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-39859b1c-f0cf-4095-ad12-22a326144b30 req-a3722c59-3f29-4fb8-83ee-7e22e744631c service nova] Creating event network-changed:0b636c68-8977-4624-b852-695f70fcb969 for instance 9a9c12f0-3345-45e1-bfad-670023235180 on hv-cinder-80377 Jun 17 08:48:06.663637 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-39859b1c-f0cf-4095-ad12-22a326144b30 req-a3722c59-3f29-4fb8-83ee-7e22e744631c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136726 Jun 17 08:48:06.664683 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 438/877] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:06.967110 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b160ac6e-fc52-457f-a209-7f2a6cc23939 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 204 len: 0 microversion: 2.1 time: 0.441196 Jun 17 08:48:06.968013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 440/878] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:48:06 2022] DELETE /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:48:06.977250 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:06.977949 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:06.984318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:06.984816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:06.985687 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:06.986125 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:07.019936 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:07.021357 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:07.027681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:07.028438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:07.029309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:07.029902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:07.064821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ede91aed-ccee-48e8-9e6d-d550f1f006eb tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049872 Jun 17 08:48:07.065497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 441/879] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:07 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:48:07.192668 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:07.198178 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8c8d7562-efb7-4f3e-93d8-64015d1521c8 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1578 microversion: 2.1 time: 0.225116 Jun 17 08:48:07.198750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 439/880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:06 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:08.076524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:08.077361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:08.084332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:08.084828 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:08.085588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:08.086027 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:08.116781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b2188761-6a6c-402c-9ba5-861cd7d8427b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Jun 17 08:48:08.124412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 442/881] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:08 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:48:08.190477 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-11814f64-c671-44e1-82c6-92e5d4277025 req-d3876d0c-b926-40e0-9942-84ed5bf92d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9c12f0-3345-45e1-bfad-670023235180", "name": "network-vif-deleted", "tag": "0b636c68-8977-4624-b852-695f70fcb969"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:08.199072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-11814f64-c671-44e1-82c6-92e5d4277025 req-d3876d0c-b926-40e0-9942-84ed5bf92d11 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:08.199511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-11814f64-c671-44e1-82c6-92e5d4277025 req-d3876d0c-b926-40e0-9942-84ed5bf92d11 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:08.210757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-11814f64-c671-44e1-82c6-92e5d4277025 req-d3876d0c-b926-40e0-9942-84ed5bf92d11 service nova] Creating event network-vif-deleted:0b636c68-8977-4624-b852-695f70fcb969 for instance 9a9c12f0-3345-45e1-bfad-670023235180 on hv-cinder-80377 Jun 17 08:48:08.215466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-11814f64-c671-44e1-82c6-92e5d4277025 req-d3876d0c-b926-40e0-9942-84ed5bf92d11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028715 Jun 17 08:48:08.216037 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 440/882] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:08.219317 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:08.220720 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:08.226856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:08.227515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:08.228063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:08.228514 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:08.295755 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:08.303874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b60e6976-736d-4deb-a1f0-f71c9fd51ebf tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1391 microversion: 2.1 time: 0.091104 Jun 17 08:48:08.309413 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 443/883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:08 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1391 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:48:09.129368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:09.130484 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:09.136684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:09.137142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:09.137904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:09.138339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:09.174483 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c4349834-5d8a-492a-acad-6da5fafe830e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050637 Jun 17 08:48:09.175058 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 441/884] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:09 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:48:09.320792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:09.321399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:09.327817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:09.328261 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:09.329100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:09.330127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:09.363666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:09.364028 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:09.364468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lazy-loading 'fault' on Instance uuid 9a9c12f0-3345-45e1-bfad-670023235180 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:48:09.403064 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:09.411410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1c99d81b-984b-4026-8f79-6bc8cf96ffcb tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1230 microversion: 2.1 time: 0.094606 Jun 17 08:48:09.411957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 444/885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:09 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:10.188254 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:10.190044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:10.196574 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:10.197029 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:10.197802 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:10.198238 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:10.227811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-78ceb6b6-3572-49ca-bd00-27028c9a4466 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044837 Jun 17 08:48:10.228361 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 442/886] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:10 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 08:48:10.428666 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:10.429287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:10.435747 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:10.436178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:10.436982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:10.437421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:10.470763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:10.471369 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:10.472225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lazy-loading 'fault' on Instance uuid 9a9c12f0-3345-45e1-bfad-670023235180 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:48:10.517556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d49cbc2d5d458881d3c2a5880f9109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60b9f54cde341cfb2e126fae67e13ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:10.524538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-89e638b6-85d1-44ec-ac68-f4337dcac997 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 200 len: 1184 microversion: 2.1 time: 0.099866 Jun 17 08:48:10.525112 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 445/887] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:10 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:10.965781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-02d11985-47a3-447d-a343-fcdff632cfca tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: .version_select at 0x7ff0251153a0>, body: {"keypair": {"name": "tempest-keypair-619239646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqlIdCfI6cr6lqpysgz1hBx5XHqSYBzC225l2P6XZ3uaRie5Npd+qjc2krgEiGNPLN9BAFaVqP5mILJOKpcHbncibD3RZyOOy4iQkZ15jBHikd8IARsOvHUBN/ZZaQc8A=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:10.981194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-02d11985-47a3-447d-a343-fcdff632cfca tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:48:10.984935 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-02d11985-47a3-447d-a343-fcdff632cfca tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:48:11.129406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-02d11985-47a3-447d-a343-fcdff632cfca tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167551 Jun 17 08:48:11.130002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 443/888] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:48:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:11.240289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:11.241255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:11.247536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.247990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.248817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.249253 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.279920 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fc1bb64a-a207-4fc0-be71-3faa1bf2ba61 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044232 Jun 17 08:48:11.280504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 446/889] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:48:11 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:11.339152 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:11.339657 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:11.346247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.346690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.347446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.347878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.373533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:48:11.542041 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:11.542657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 9a9c12f0-3345-45e1-bfad-670023235180] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:11.549692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.550142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.550902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.551338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.566831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] HTTP exception thrown: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Request method failure captured: Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 HTTP/1.1 Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD1kPfLyzF6yv-3ZrH-dhQM22uWWBA3QJCdxUSg5J6HfB7BYrZvcH_r1hsiU_ggADrX8rpR_sEsQS5iZNAMyjcCtSekjv-1oP9w8hGWIhGhxi1dFAPXPeFUcTIVvp6mB0WnGKszRv3Haf0blEnxxfiM0wGWz9BzKTJRICm1mGTU8S1Y Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:48:11.575419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 94d49cbc2d5d458881d3c2a5880f9109 Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. Jun 17 08:48:11.577200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '9a9c12f0-3345-45e1-bfad-670023235180'} Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:48:11.578090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. Jun 17 08:48:11.580015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:11.581387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Returning 404 to user: Instance 9a9c12f0-3345-45e1-bfad-670023235180 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:48:11.581387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c2e2519b-40b5-40f7-a114-d08d79804254 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180" status: 404 len: 111 microversion: 2.1 time: 0.031798 Jun 17 08:48:11.581387 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 447/890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:11 2022] GET /compute/v2.1/servers/9a9c12f0-3345-45e1-bfad-670023235180 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 08:48:11.807070 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-15b19c33-a3a3-40bd-a7a1-a8823bee00f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 204 len: 0 microversion: 2.20 time: 0.471997 Jun 17 08:48:11.807660 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 444/891] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 08:48:11 2022] DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:48:11.823557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:11.823557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:11.823557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.824166 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.825032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:11.825472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:11.961250 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:11.969461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:11.971706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:11.972925 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bd489507-134b-4b59-bdf2-11f654eeb42b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.160890 Jun 17 08:48:11.978445 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 448/892] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:11 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:12.099966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:12.100704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:12.106676 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:12.107129 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:12.107892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:12.108364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:12.121810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] HTTP exception thrown: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Request method failure captured: Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 HTTP/1.1 Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD1kPfLyzF6yv-3ZrH-dhQM22uWWBA3QJCdxUSg5J6HfB7BYrZvcH_r1hsiU_ggADrX8rpR_sEsQS5iZNAMyjcCtSekjv-1oP9w8hGWIhGhxi1dFAPXPeFUcTIVvp6mB0WnGKszRv3Haf0blEnxxfiM0wGWz9BzKTJRICm1mGTU8S1Y Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:48:12.123435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 94d49cbc2d5d458881d3c2a5880f9109 Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.125047 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '98d86760-ca41-4e0a-93bf-6ff2f8ba6b03'} Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:48:12.125927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.127882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.129395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Returning 404 to user: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:48:12.129395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-77279cf4-1d01-4e18-b693-6c21815f4afd tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 404 len: 111 microversion: 2.1 time: 0.030104 Jun 17 08:48:12.129395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 445/893] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:48:12 2022] DELETE /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:48:12.134013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:12.134559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] [instance: 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:12.140628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:12.141081 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:12.142614 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:12.143137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:12.149323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:12.159348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] HTTP exception thrown: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Request method failure captured: Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 HTTP/1.1 Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD1kPfLyzF6yv-3ZrH-dhQM22uWWBA3QJCdxUSg5J6HfB7BYrZvcH_r1hsiU_ggADrX8rpR_sEsQS5iZNAMyjcCtSekjv-1oP9w8hGWIhGhxi1dFAPXPeFUcTIVvp6mB0WnGKszRv3Haf0blEnxxfiM0wGWz9BzKTJRICm1mGTU8S1Y Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:48:12.160930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b60b9f54cde341cfb2e126fae67e13ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: b60b9f54cde341cfb2e126fae67e13ef Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-TestVolumeBootPattern-381248049 Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 94d49cbc2d5d458881d3c2a5880f9109 Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-TestVolumeBootPattern-381248049-project Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.162488 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '98d86760-ca41-4e0a-93bf-6ff2f8ba6b03'} Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:48:12.163411 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. Jun 17 08:48:12.165180 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:12.166504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Returning 404 to user: Instance 98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:48:12.166504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7e536d7e-21ca-4f0f-bfea-cca51f62d2ae tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03" status: 404 len: 111 microversion: 2.1 time: 0.032370 Jun 17 08:48:12.166504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 449/894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:12 2022] GET /compute/v2.1/servers/98d86760-ca41-4e0a-93bf-6ff2f8ba6b03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:48:12.992106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:12.992758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:12.999492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:12.999930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:13.000725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:13.002173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:13.227013 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:13.230735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:13.236393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:13.237959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:13.239143 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6dcea67d-5eee-4047-8665-3d24465e6eb8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.251083 Jun 17 08:48:13.239696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 446/895] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:12 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:13.790040 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-963552e6-b7b9-456a-826a-d460c45809d4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] Calling method '.version_select at 0x7ff0250639d0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:13.921945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-286682345", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09b364a3-a026-409b-a21c-0c0c53a97d24"}], "security_groups": [{"name": "tempest-securitygroup--669344887"}], "key_name": "tempest-keypair-619239646", "user_data": "}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:13.928062 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-963552e6-b7b9-456a-826a-d460c45809d4 tempest-TestVolumeBootPattern-381248049 tempest-TestVolumeBootPattern-381248049-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2085413800" status: 202 len: 0 microversion: 2.1 time: 0.142413 Jun 17 08:48:13.928671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 450/896] 10.222.0.48 () {58 vars in 1262 bytes} [Fri Jun 17 08:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2085413800 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:48:14.092466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] validate_networks() for [('09b364a3-a026-409b-a21c-0c0c53a97d24', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:48:14.259517 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:14.260142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:14.269109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:14.270237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:14.271055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:14.271671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:14.818856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:14.840606 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:14.843103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:14.844595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-9f1e109d-8324-4414-a44e-46767d2c4f0f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1725 microversion: 2.20 time: 0.589567 Jun 17 08:48:14.851133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 451/897] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:14 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1725 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:48:15.142916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:48:15.143478 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:48:15.143866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:48:15.144310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:48:15.144807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:48:15.156663 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:15.157719 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:15.158331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:15.158909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:15.184648 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:48:15.190511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:48:15.203559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:48:15.206481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:48:15.433838 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1704dfb7-6357-4b7d-af07-d2a923240a27 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.516073 Jun 17 08:48:15.434981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 447/898] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:48:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:48:15.445325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a83ad691-f8c1-4015-ad24-554b9bfc7366 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:15.453583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a83ad691-f8c1-4015-ad24-554b9bfc7366 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:15.556889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a83ad691-f8c1-4015-ad24-554b9bfc7366 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:15.565769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a83ad691-f8c1-4015-ad24-554b9bfc7366 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1240 microversion: 2.1 time: 0.124445 Jun 17 08:48:15.566945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 452/899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:15 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:15.776990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-ed8b3268-ab5f-4ba5-86b7-2eebaaae6be9 req-a7e4fe7c-7e5d-432b-b06e-e4821d414910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bece42f-d5e6-4ee3-a9f0-7fb04719de09", "name": "network-vif-deleted", "tag": "e5359665-c301-415c-97ae-694f057f3aad"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:15.790878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ed8b3268-ab5f-4ba5-86b7-2eebaaae6be9 req-a7e4fe7c-7e5d-432b-b06e-e4821d414910 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:15.791350 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ed8b3268-ab5f-4ba5-86b7-2eebaaae6be9 req-a7e4fe7c-7e5d-432b-b06e-e4821d414910 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:15.812616 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-ed8b3268-ab5f-4ba5-86b7-2eebaaae6be9 req-a7e4fe7c-7e5d-432b-b06e-e4821d414910 service nova] Creating event network-vif-deleted:e5359665-c301-415c-97ae-694f057f3aad for instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 on hv-cinder-80377 Jun 17 08:48:15.823251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-ed8b3268-ab5f-4ba5-86b7-2eebaaae6be9 req-a7e4fe7c-7e5d-432b-b06e-e4821d414910 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048166 Jun 17 08:48:15.828585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 448/900] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:15.865624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:15.867243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:15.893959 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:15.906885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:15.909669 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:15.910139 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:16.109629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:16.130998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:16.142586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:16.145010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7015c655-e196-41bb-86ad-022d077cc43e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 200 len: 1657 microversion: 2.20 time: 0.285776 Jun 17 08:48:16.153390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 453/901] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:15 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 1657 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:16.587030 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:16.588721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:16.598215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:16.598961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:16.600373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:16.601074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:16.735382 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:16.744891 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-13f95992-e51b-42f7-8233-0b4e439f9bda tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1244 microversion: 2.1 time: 0.162481 Jun 17 08:48:16.745553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 449/902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:16 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:17.166513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:17.166513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:17.172289 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:17.172836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:17.173612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:17.174055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:17.187572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 HTTP/1.1 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:48:17.195327 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:48:17.197119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '2bece42f-d5e6-4ee3-a9f0-7fb04719de09'} Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:48:17.198117 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:48:17.199622 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:48:17.201018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:48:17.201018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-257235bf-be84-49d4-b082-58102eb67e4b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 404 len: 111 microversion: 2.20 time: 0.030991 Jun 17 08:48:17.201018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 454/903] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:17 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:48:17.207114 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0c48e6c6-4acd-4f57-860a-56a4cbffabdf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '.version_select at 0x7ff025191dc0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:17.310640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0c48e6c6-4acd-4f57-860a-56a4cbffabdf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341666417" status: 204 len: 0 microversion: 2.20 time: 0.108113 Jun 17 08:48:17.311226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 450/904] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jun 17 08:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341666417 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:48:17.762966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:17.764011 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:17.779189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:17.780395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:17.781222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:17.782499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:17.892331 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:17.902071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e7c678ac-df12-49dc-ae20-ff332114e8e7 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1292 microversion: 2.1 time: 0.142801 Jun 17 08:48:17.909215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 455/905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:17 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1292 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:18.495882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c9dfa279-b073-43ce-8beb-f803d0d04705 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: .version_select at 0x7ff0250f5a60>, body: {"keypair": {"name": "tempest-keypair-1735022799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZQTeAZeckyF1HMHsufFZeIyOPQpreVOjB/TsYenYfrkrdDJv70J8u7PaxTO//DZJXgRsqac0QKgPNkBLgXZIcVx6yfkCeiYpygdtiBS7PuN7w1lH+il3MAq6MBRD9eew=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:18.517012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-c9dfa279-b073-43ce-8beb-f803d0d04705 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:48:18.522394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-c9dfa279-b073-43ce-8beb-f803d0d04705 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for user 1885c809018b4f0890028ba202aa415b and project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:48:18.642878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c9dfa279-b073-43ce-8beb-f803d0d04705 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.158082 Jun 17 08:48:18.644435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 451/906] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 08:48:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 08:48:18.925966 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:18.927355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:18.934040 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:18.934889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:18.935620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:18.936329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:19.239716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:19.246914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c75b7e0d-8e2c-443b-aee2-5f1bd0ce193b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1298 microversion: 2.1 time: 0.324977 Jun 17 08:48:19.247627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 456/907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:18 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1298 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:20.266894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:20.267840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:20.282725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:20.283422 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:20.284932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:20.285462 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:20.570773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:20.579846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b4a02c1b-42e2-4d56-bc87-47e8804db39c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.318036 Jun 17 08:48:20.581259 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 452/908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:20 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:20.691632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-6d99e66c-b19e-44b9-b2fb-b811b8f04463 req-15905dfb-60c3-48b9-b474-27ffb4ccef92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d442aa1-cf7a-41a5-8a63-933e148bd8cd", "tag": "f48eb871-109e-48f7-9a1b-07ce52d45515"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:20.705410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6d99e66c-b19e-44b9-b2fb-b811b8f04463 req-15905dfb-60c3-48b9-b474-27ffb4ccef92 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:20.706126 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6d99e66c-b19e-44b9-b2fb-b811b8f04463 req-15905dfb-60c3-48b9-b474-27ffb4ccef92 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:20.733894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-6d99e66c-b19e-44b9-b2fb-b811b8f04463 req-15905dfb-60c3-48b9-b474-27ffb4ccef92 service nova] Creating event network-changed:f48eb871-109e-48f7-9a1b-07ce52d45515 for instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd on hv-cinder-80377 Jun 17 08:48:20.741139 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-6d99e66c-b19e-44b9-b2fb-b811b8f04463 req-15905dfb-60c3-48b9-b474-27ffb4ccef92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054063 Jun 17 08:48:20.741726 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 457/909] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:21.598131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:21.598757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:21.605467 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:21.606172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:21.606948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:21.607385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:21.845172 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:21.853297 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4d28e576-a552-4d75-8ec9-f9c8416b5835 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.259746 Jun 17 08:48:21.853879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 453/910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:21 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:22.379320 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2058840451", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "704466d8-40db-4ba5-9430-c24f097c9174"}], "security_groups": [{"name": "tempest-securitygroup--213129737"}], "key_name": "tempest-keypair-1735022799", "user_data": "}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:22.502086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] validate_networks() for [('704466d8-40db-4ba5-9430-c24f097c9174', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:48:22.871406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:22.872366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:22.879410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:22.879970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:22.880867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:22.881444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:22.964985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:48:22.965504 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:48:22.966000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:48:22.966400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:48:22.966813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:48:22.976441 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:22.980162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:22.980162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:22.980162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:22.995448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:48:22.999599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Getting quotas for user 1885c809018b4f0890028ba202aa415b and project 21bdae6c05954d4aa06501fec56a19a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:48:23.015842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:48:23.018879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:48:23.041116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:23.051080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-300ed13d-1e15-4272-9c54-1ae4b8d84fdb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.184530 Jun 17 08:48:23.051664 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 454/911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:22 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:23.175792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-00b5226a-a7d6-4388-b792-3f4fdeb7f7bd tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.803018 Jun 17 08:48:23.176435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 458/912] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 08:48:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 08:48:23.186371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:23.186994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:23.190169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:23.241892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:23.249191 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:23.250945 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:23.252087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-dc5a9841-78d3-42b6-bd95-987eb42c0aa0 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1282 microversion: 2.20 time: 0.069643 Jun 17 08:48:23.259133 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 455/913] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:23 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:24.069461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:24.070177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:24.077385 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:24.077842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:24.078618 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:24.079243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:24.227553 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:24.232378 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-687e1b00-09a4-4ea2-905b-da4c47e0ac78 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.167571 Jun 17 08:48:24.232965 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 459/914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:24 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:24.270404 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:24.271145 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:24.280646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:24.281108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:24.281898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:24.282341 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:24.346897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:24.359161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:24.361658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:24.362770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d78064ff-f3b6-4d90-8f99-4c6224b6c9af tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1286 microversion: 2.20 time: 0.096707 Jun 17 08:48:24.363413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 456/915] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:24 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:25.251711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:25.252593 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:25.259942 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:25.260401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:25.261290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:25.262335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:25.381562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:25.382637 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:25.385184 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:25.392876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:25.393499 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:25.394392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:25.394938 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:25.411280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:25.419506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-694520ad-c4f3-40ce-9b1d-bf7e9d6621fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.173174 Jun 17 08:48:25.420078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 460/916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:25 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:25.476299 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:25.484389 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:25.487148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:25.488268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2f229a59-75f1-4119-a055-e3921127d33a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1334 microversion: 2.20 time: 0.111064 Jun 17 08:48:25.488862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 457/917] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:25 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:26.436985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:26.437703 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:26.444754 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:26.445479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:26.446435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:26.446868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:26.507305 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:26.507922 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:26.515660 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:26.516659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:26.517572 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:26.518074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:26.718872 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:26.723717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4543d716-7527-4139-858a-0dd200a467d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.290749 Jun 17 08:48:26.725242 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 461/918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:26 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:26.774959 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:26.783248 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:26.784787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:26.785949 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a45da7dd-e412-484e-83aa-74984389c12a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.283246 Jun 17 08:48:26.786503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 458/919] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:26 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:27.551296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-b433db9c-b55d-4764-aa4a-89110bff5821 req-72305355-f604-4a54-90e4-bda71f670014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:27.559998 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b433db9c-b55d-4764-aa4a-89110bff5821 req-72305355-f604-4a54-90e4-bda71f670014 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:27.562000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-b433db9c-b55d-4764-aa4a-89110bff5821 req-72305355-f604-4a54-90e4-bda71f670014 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:27.574259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-b433db9c-b55d-4764-aa4a-89110bff5821 req-72305355-f604-4a54-90e4-bda71f670014 service nova] Creating event network-changed:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:48:27.579170 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-b433db9c-b55d-4764-aa4a-89110bff5821 req-72305355-f604-4a54-90e4-bda71f670014 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032756 Jun 17 08:48:27.579992 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 462/920] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:27.742746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:27.743363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:27.750075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:27.750526 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:27.751848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:27.752071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:27.804686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:27.805384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:27.807393 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:27.812361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:27.813497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:27.813804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:27.814356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:28.035335 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:28.043162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bce32f43-6c07-49c9-b140-bd73f7af5e7f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.304273 Jun 17 08:48:28.043754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 459/921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:27 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:28.320831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:28.330187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:28.331845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:28.333005 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1290ba0d-582b-4d63-bfe5-fb55d2264100 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.532578 Jun 17 08:48:28.333563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 463/922] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:27 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:48:28.380659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-1924f60b-fc97-496d-9ece-cd7e2db99f13 req-02939cbf-05b8-481b-a43b-b701eb831a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d442aa1-cf7a-41a5-8a63-933e148bd8cd", "name": "network-vif-plugged", "status": "completed", "tag": "f48eb871-109e-48f7-9a1b-07ce52d45515"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:28.388966 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1924f60b-fc97-496d-9ece-cd7e2db99f13 req-02939cbf-05b8-481b-a43b-b701eb831a50 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:28.389419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1924f60b-fc97-496d-9ece-cd7e2db99f13 req-02939cbf-05b8-481b-a43b-b701eb831a50 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:28.401314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-1924f60b-fc97-496d-9ece-cd7e2db99f13 req-02939cbf-05b8-481b-a43b-b701eb831a50 service nova] Creating event network-vif-plugged:f48eb871-109e-48f7-9a1b-07ce52d45515 for instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd on hv-cinder-80377 Jun 17 08:48:28.406338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-1924f60b-fc97-496d-9ece-cd7e2db99f13 req-02939cbf-05b8-481b-a43b-b701eb831a50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030564 Jun 17 08:48:28.406937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 460/923] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:29.060550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:29.061165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:29.067719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:29.068168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:29.068948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:29.069381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:29.200093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:29.208190 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b219f0ac-64fa-4a69-bd12-9f008b4bb100 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.151651 Jun 17 08:48:29.208790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 464/924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:29 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:29.352822 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:29.353510 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:29.359674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:29.360116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:29.361376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:29.361810 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:29.487798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:29.495787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:29.497364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:29.498463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a66959fa-8173-4f36-8f3c-6e55046e2161 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.150447 Jun 17 08:48:29.499019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 461/925] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:29 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:30.224297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:30.224933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:30.231483 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:30.231945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:30.232755 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:30.233195 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:30.366390 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:30.373844 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-15ce849b-c5ba-4939-85af-0ddd5804b4fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.153467 Jun 17 08:48:30.374403 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 465/926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:30 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:48:30.516461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:30.517175 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:30.524634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:30.525087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:30.525846 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:30.526275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:30.658540 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:30.666704 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:30.668194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:30.669320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-22a83c0e-6836-499d-b502-7753c67f0ad8 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.156877 Jun 17 08:48:30.669874 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 462/927] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:30 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:31.391386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:31.392003 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:31.398668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:31.399123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:31.399886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:31.400323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:31.528371 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:31.537070 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2e878b93-9edf-4b77-a0a4-527dd6aa00c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1365 microversion: 2.1 time: 0.149570 Jun 17 08:48:31.537635 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 466/928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:31 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:31.687983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:31.688533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:31.695220 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:31.695677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:31.696440 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:31.696940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:31.829577 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:31.839348 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:31.842071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:31.843243 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c68dcc91-c923-4539-a6c8-786c2a2463a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.159277 Jun 17 08:48:31.843798 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 463/929] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:31 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:32.555366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:32.556014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:32.562609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.563052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.563912 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.565093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.694234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:32.701653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2cd6854a-bd07-4076-a7cd-1a7e8cd3fbf6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1555 microversion: 2.1 time: 0.150245 Jun 17 08:48:32.702340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 467/930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:48:32 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:48:32.718559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:32.719084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:32.726012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.726462 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.727251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.727686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.806627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4b1828a5-ea67-438a-a304-cb501154a33f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091829 Jun 17 08:48:32.807252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 464/931] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:48:32 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:32.864585 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:32.865426 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:32.872385 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.873322 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.874098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:32.874562 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:32.987346 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:33.009130 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=8 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:33.125690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:33.133530 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:33.135126 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:33.136243 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b27cfb3-4db8-4a7f-a766-ac54eeeb55d9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.277212 Jun 17 08:48:33.136832 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 468/932] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:32 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:33.869706 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=16 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:33.874241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-7df10d5f-3f35-4ec9-80f9-a4bfd2b9e9f5 req-319cc529-4808-4bd0-a2d0-cb2bbe4ad909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d442aa1-cf7a-41a5-8a63-933e148bd8cd", "tag": "f48eb871-109e-48f7-9a1b-07ce52d45515"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:33.882868 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-7df10d5f-3f35-4ec9-80f9-a4bfd2b9e9f5 req-319cc529-4808-4bd0-a2d0-cb2bbe4ad909 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:33.883313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-7df10d5f-3f35-4ec9-80f9-a4bfd2b9e9f5 req-319cc529-4808-4bd0-a2d0-cb2bbe4ad909 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:33.894321 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-7df10d5f-3f35-4ec9-80f9-a4bfd2b9e9f5 req-319cc529-4808-4bd0-a2d0-cb2bbe4ad909 service nova] Creating event network-changed:f48eb871-109e-48f7-9a1b-07ce52d45515 for instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd on hv-cinder-80377 Jun 17 08:48:33.903490 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-7df10d5f-3f35-4ec9-80f9-a4bfd2b9e9f5 req-319cc529-4808-4bd0-a2d0-cb2bbe4ad909 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034395 Jun 17 08:48:33.904087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 465/933] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:34.154878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:34.156825 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:34.165269 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:34.165946 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:34.167210 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:34.167330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:34.398319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:34.411770 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:34.415513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:34.416745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2bb426c3-fa60-45dc-ad00-94559b7fbe70 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.266425 Jun 17 08:48:34.417317 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 469/934] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:34 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:34.482173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-56698705-8a69-45b3-829d-0bd37ce691a4 req-6b049913-8b41-40e8-bb07-7f615645fe39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "name": "network-vif-plugged", "status": "completed", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:34.493983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-56698705-8a69-45b3-829d-0bd37ce691a4 req-6b049913-8b41-40e8-bb07-7f615645fe39 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:34.494572 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-56698705-8a69-45b3-829d-0bd37ce691a4 req-6b049913-8b41-40e8-bb07-7f615645fe39 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:34.506175 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-56698705-8a69-45b3-829d-0bd37ce691a4 req-6b049913-8b41-40e8-bb07-7f615645fe39 service nova] Creating event network-vif-plugged:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:48:34.510915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-56698705-8a69-45b3-829d-0bd37ce691a4 req-6b049913-8b41-40e8-bb07-7f615645fe39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Jun 17 08:48:34.511692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 466/935] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:48:35.435873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:35.436543 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:35.443165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:35.443608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:35.444361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:35.444821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:35.575155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:35.583624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:35.585155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:35.586259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1536665f-dc86-45e6-a42c-d5f2a57bd059 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.154292 Jun 17 08:48:35.586851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 470/936] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:35 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:36.604977 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:36.605678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:36.612522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:36.612958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:36.613729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:36.617318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:36.752646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:36.760463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:36.762073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:36.763169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3e8c2e6f-1128-478e-a091-20a729dda5e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1407 microversion: 2.20 time: 0.163046 Jun 17 08:48:36.763720 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 467/937] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:36 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:37.781733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:37.782343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:37.789557 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:37.790254 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:37.791009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:37.791443 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:37.795389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:37.923695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:37.932418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:37.933934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:48:37.935066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-439f391a-2c36-44ec-acba-2cd4c7320687 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1600 microversion: 2.20 time: 0.157356 Jun 17 08:48:37.935608 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 471/938] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:48:37 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:48:37.952250 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:48:37.952797 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:48:37.959314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:37.959770 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:37.960562 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:37.961007 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:38.037017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-80a4bb9e-ea1e-498a-9437-573f262f0765 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088619 Jun 17 08:48:38.037651 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 468/939] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 08:48:37 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:48:39.257565 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-7d41dd81-1b83-4b1e-9ea9-cb337ad0042e req-9092f0c1-6316-4b1c-bc36-c2afe7cd444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:48:39.265948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7d41dd81-1b83-4b1e-9ea9-cb337ad0042e req-9092f0c1-6316-4b1c-bc36-c2afe7cd444b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:48:39.266437 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7d41dd81-1b83-4b1e-9ea9-cb337ad0042e req-9092f0c1-6316-4b1c-bc36-c2afe7cd444b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:48:39.277505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-7d41dd81-1b83-4b1e-9ea9-cb337ad0042e req-9092f0c1-6316-4b1c-bc36-c2afe7cd444b service nova] Creating event network-changed:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:48:39.282499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-7d41dd81-1b83-4b1e-9ea9-cb337ad0042e req-9092f0c1-6316-4b1c-bc36-c2afe7cd444b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028548 Jun 17 08:48:39.283699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 472/940] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:49:54.381242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=28 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.382234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=90 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:54.574315 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:54.574813 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:49:54.581022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:54.584032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:54.584032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:54.584032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:54.607077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-25463489-9ca8-48e3-b47f-b4e703c058c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/ips" status: 200 len: 152 microversion: 2.20 time: 0.228138 Jun 17 08:49:54.607631 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 469/941] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 08:49:54 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/ips => generated 152 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:49:56.718087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=19 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:56.718833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:56.723391 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:49:56.726103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:49:56.730124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:56.730575 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:56.731338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:56.731782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:56.754135 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lazy-loading 'flavor' on Instance uuid 84fb49a7-1949-4683-ad72-357e0b9b42f4 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:49:57.302015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3dea9319-50bd-461b-baf6-a446f65672c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/action" status: 202 len: 0 microversion: 2.20 time: 0.585857 Jun 17 08:49:57.302644 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 473/942] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 08:49:56 2022] POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:49:57.311260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:57.311919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:49:57.318432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:57.327876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:57.327876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:57.327876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:57.455001 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:57.463158 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:57.464695 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:57.465865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5e9f4f84-d1c4-45b5-8350-c3f5ddbb24f5 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.158466 Jun 17 08:49:57.466418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 470/943] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:49:57 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:49:58.486252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:58.486948 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:49:58.493808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:58.494252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:58.495009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:58.495442 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:58.628309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:58.637068 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:58.638570 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:58.639734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-64cacf1e-a7e0-44a9-a9e3-121ba3b7a836 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.158247 Jun 17 08:49:58.640292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 474/944] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:49:58 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:49:59.658100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:49:59.658734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:49:59.665555 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:59.666012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:59.667039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:49:59.667473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:49:59.795110 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:59.802915 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:59.805010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:49:59.806166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-66862698-d7cd-4782-989c-06b43136a3db tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.151956 Jun 17 08:49:59.806713 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 471/945] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:49:59 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:00.648252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:00.648869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:00.655389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.655836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.656637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.657071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.682938 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7b1f37ee-2e54-4384-a3ae-5ee75561a552 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.039176 Jun 17 08:50:00.683522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 475/946] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:50:00 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:00.693828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7f33af8-1090-4c5b-8946-6b4dcf5af5a1"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:00.694956 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:00.701487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.701943 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.702708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.703148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.780867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: POST /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/os-volume_attachments HTTP/1.1 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 74 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:50:00.782622 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {"volumeAttachment": {"volumeId": "c7f33af8-1090-4c5b-8946-6b4dcf5af5a1"}} Jun 17 08:50:00.784397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'server_id': '2d442aa1-cf7a-41a5-8a63-933e148bd8cd', 'body': {'volumeAttachment': {'volumeId': 'c7f33af8-1090-4c5b-8946-6b4dcf5af5a1'}}} Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:50:00.785418 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:00.786974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 400 to user: Invalid volume: volume c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 is already attached to instances: 0e311d6c-6487-46f7-a413-b07f95d91018 {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fd0b4b5c-31bb-4568-af7f-1b0dbc0d31b3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094178 Jun 17 08:50:00.789234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 472/947] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:50:00 2022] POST /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:50:00.793492 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:00.793995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:00.799984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.800386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.801178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.801616 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.824368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:00.825014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:00.826113 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:50:00.831184 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.831631 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.832399 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:00.832860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:00.969480 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:00.977339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:00.978866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:00.980107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-49ca56cc-e8ab-4f2d-8bd2-bb05b7918cb6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.159558 Jun 17 08:50:00.980690 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 473/948] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:00 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:01.142735 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-902f93d5-e925-42b1-b23c-4b3dc6ec43d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 204 len: 0 microversion: 2.1 time: 0.352906 Jun 17 08:50:01.143330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 476/949] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:50:00 2022] DELETE /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:50:01.152079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:01.152925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:01.159074 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:01.159523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:01.160285 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:01.160748 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:01.299149 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:01.307433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-be1f7276-5076-4e8d-a767-cfe8adad8f42 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1680 microversion: 2.1 time: 0.159864 Jun 17 08:50:01.307990 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 474/950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:01 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:01.998984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:01.999678 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:02.006150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:02.006596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:02.007867 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:02.008302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:02.144848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:02.149510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:02.151028 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:02.152218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-eb660b67-9596-4be8-b7e6-2bb74401724c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.157519 Jun 17 08:50:02.152812 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 477/951] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:01 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:02.326023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:02.326547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:02.332977 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:02.333423 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:02.334173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:02.335127 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:02.463456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:02.470877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7f9a2867-6639-463d-bf16-7d890db997e9 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1680 microversion: 2.1 time: 0.148879 Jun 17 08:50:02.471437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 475/952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:02 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:03.171487 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:03.172015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:03.179118 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:03.179584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:03.180354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:03.180818 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:03.379485 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:03.387680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:03.389248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:03.390415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cfbea80d-f28c-4c0b-8773-a2a5d8004278 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.222920 Jun 17 08:50:03.390971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 478/953] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:03 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:03.488696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:03.489336 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:03.495957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:03.496421 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:03.497226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:03.497679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:03.624258 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:03.631969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c4cc3081-2b3a-484a-9b97-a93b4bd3f08c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1680 microversion: 2.1 time: 0.147461 Jun 17 08:50:03.632588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 476/954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:03 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:50:03.949449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-2e28383e-8fff-43f4-b802-6ba95ef838fe req-480fafed-8910-4ff4-8a54-87fa08b6e3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d442aa1-cf7a-41a5-8a63-933e148bd8cd", "name": "network-vif-deleted", "tag": "f48eb871-109e-48f7-9a1b-07ce52d45515"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:03.958075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-2e28383e-8fff-43f4-b802-6ba95ef838fe req-480fafed-8910-4ff4-8a54-87fa08b6e3dc service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:03.958534 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-2e28383e-8fff-43f4-b802-6ba95ef838fe req-480fafed-8910-4ff4-8a54-87fa08b6e3dc service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:03.971161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-2e28383e-8fff-43f4-b802-6ba95ef838fe req-480fafed-8910-4ff4-8a54-87fa08b6e3dc service nova] Creating event network-vif-deleted:f48eb871-109e-48f7-9a1b-07ce52d45515 for instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd on hv-cinder-80377 Jun 17 08:50:03.976322 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-2e28383e-8fff-43f4-b802-6ba95ef838fe req-480fafed-8910-4ff4-8a54-87fa08b6e3dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030571 Jun 17 08:50:03.977174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 479/955] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:04.409203 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:04.409816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:04.416108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:04.416866 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:04.417633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:04.418072 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:04.548511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:04.560939 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:04.562967 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:04.564095 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e4a6d994-0c6c-401e-9d1e-0267a3c53fec tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.158963 Jun 17 08:50:04.574135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 477/956] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:04 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:04.649871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:04.650582 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:04.657379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:04.657827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:04.658595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:04.659036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:04.692178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:04.692658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:04.693126 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'fault' on Instance uuid 2d442aa1-cf7a-41a5-8a63-933e148bd8cd {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:50:04.735396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:04.744000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f21c77d6-76bb-4710-80c3-5b61355c1148 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 200 len: 1330 microversion: 2.1 time: 0.098543 Jun 17 08:50:04.744612 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 480/957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:04 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:05.583919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:05.585322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:05.592643 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:05.593100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:05.593878 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:05.594310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:05.726723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:05.735260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:05.736791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:05.737958 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-10d2d6b0-be66-406d-b6bf-96e5cf0750c6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.158005 Jun 17 08:50:05.738513 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 478/958] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:05 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:05.762147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:05.762764 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:05.769227 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:05.769696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:05.770470 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:05.770908 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:05.784449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd HTTP/1.1 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:50:05.786142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:50:05.787820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '2d442aa1-cf7a-41a5-8a63-933e148bd8cd'} Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:50:05.789544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:50:05.791053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:05.792710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:50:05.792710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cf0d0b4f-4d88-4779-bdae-76ee2db541d0 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 404 len: 111 microversion: 2.1 time: 0.029341 Jun 17 08:50:05.792710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 481/959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:05 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:50:05.797854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a623c15e-6038-44cd-9cda-4d72336631b1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '.version_select at 0x7ff025222310>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:05.938401 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a623c15e-6038-44cd-9cda-4d72336631b1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619239646" status: 202 len: 0 microversion: 2.1 time: 0.144941 Jun 17 08:50:05.938994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 479/960] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 08:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619239646 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:50:06.767024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:06.767024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:06.767024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:06.767024 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:06.767947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:06.767947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:06.866817 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:06.867410 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:06.876069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:06.876554 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:06.877750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:06.878198 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:06.933987 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:06.943409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:06.945454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:06.946651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4390e610-2bc8-45f5-9196-d5e745c36fae tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.194078 Jun 17 08:50:06.947207 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 482/961] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:06 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:06.993585 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'services' on Instance uuid 0e311d6c-6487-46f7-a413-b07f95d91018 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:50:07.212257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-feb92258-384a-4acf-989b-c1d73cee597d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments/c7f33af8-1090-4c5b-8946-6b4dcf5af5a1" status: 202 len: 0 microversion: 2.1 time: 0.350204 Jun 17 08:50:07.213845 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 480/962] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:50:06 2022] DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments/c7f33af8-1090-4c5b-8946-6b4dcf5af5a1 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:50:07.222499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:07.224545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:07.232232 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:07.232731 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:07.233515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:07.233946 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:07.268389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e99711ea-38ce-4c08-ae43-7122c87122db tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049858 Jun 17 08:50:07.268975 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 483/963] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:50:07 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:50:07.965549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:07.969960 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:07.972516 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:07.972993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:07.973751 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:07.974186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:08.110896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:08.119245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:08.120755 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:08.121914 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fbba121e-9ddb-455c-ad60-b93cf6861ab7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.161173 Jun 17 08:50:08.122461 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 481/964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:07 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:08.280636 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:08.281528 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:08.288700 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:08.289161 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:08.289927 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:08.290368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:08.325968 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ca6d315d-7516-4308-8648-77e3d336a7c5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049465 Jun 17 08:50:08.326529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 484/965] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:50:08 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:09.140981 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:09.141964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:09.149197 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.149658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.150478 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.150917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.292100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:09.292100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:09.292365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:09.292365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d0f81465-f62c-4390-a8cb-133d2e639b7e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1745 microversion: 2.20 time: 0.153276 Jun 17 08:50:09.292365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 482/966] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:09 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:09.337824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:09.338783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:09.345374 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.350734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.350734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.350734 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.375928 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-297299fd-be82-4c06-9b24-484758b37f91 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042311 Jun 17 08:50:09.376475 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 485/967] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:50:09 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:50:09.433085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:09.433588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:09.439548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.440007 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.440811 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.441247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.465623 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:50:09.845827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-69642643-988e-4a5a-8a64-92398c35d330 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 204 len: 0 microversion: 2.1 time: 0.416827 Jun 17 08:50:09.846412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 483/968] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:50:09 2022] DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:50:09.856727 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:09.856727 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:09.861805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.862261 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.863020 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:09.863455 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:09.990756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:09.998518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-31e08349-b239-4263-9c92-0dff2e59def1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1681 microversion: 2.1 time: 0.147212 Jun 17 08:50:09.999089 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 486/969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:09 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:10.309605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:10.310236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:10.316728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:10.317186 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:10.317954 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:10.318395 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:10.337464 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:10.451826 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:10.459645 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:10.461194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:10.462354 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a232ff35-e1d3-4c63-a634-5822b38a571f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1745 microversion: 2.20 time: 0.157109 Jun 17 08:50:10.462906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 484/970] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:10 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:11.016415 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:11.017054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:11.024262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:11.024741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:11.025505 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:11.025945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:11.030182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:11.157898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:11.166055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aa01aee7-3d05-4776-aaab-14dff3e29e94 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1681 microversion: 2.1 time: 0.153601 Jun 17 08:50:11.166869 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 487/971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:11 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:11.480449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:11.481093 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:11.488101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:11.488601 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:11.489373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:11.489812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:11.619509 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:11.627310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:11.628843 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:11.630002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e4ee9fc0-41d0-4797-888a-c90b45fa391f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1745 microversion: 2.20 time: 0.153461 Jun 17 08:50:11.630559 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 485/972] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:11 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:12.184089 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:12.184663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:12.191497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:12.191957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:12.192752 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:12.193193 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:12.318980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:12.326439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-752e6f60-bc3b-4690-9c5d-bd02738bac80 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1681 microversion: 2.1 time: 0.146535 Jun 17 08:50:12.327007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 488/973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:12 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:50:12.650071 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:12.651187 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:12.658415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:12.658880 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:12.659694 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:12.660214 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:12.913458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:12.922548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:12.925023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-4520af8e-2acc-4365-8cc1-26c55da7d095 req-44c7233d-02dd-4498-b832-1e622f1023d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "name": "network-vif-plugged", "status": "completed", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:12.925163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:12.925595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-18b2ad9d-b6e3-48aa-9f32-96754413ee28 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1745 microversion: 2.20 time: 0.280223 Jun 17 08:50:12.926711 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 486/974] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:12 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1745 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:12.934599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4520af8e-2acc-4365-8cc1-26c55da7d095 req-44c7233d-02dd-4498-b832-1e622f1023d3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:12.935144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4520af8e-2acc-4365-8cc1-26c55da7d095 req-44c7233d-02dd-4498-b832-1e622f1023d3 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:12.947358 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-4520af8e-2acc-4365-8cc1-26c55da7d095 req-44c7233d-02dd-4498-b832-1e622f1023d3 service nova] Creating event network-vif-plugged:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:50:12.952395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-4520af8e-2acc-4365-8cc1-26c55da7d095 req-44c7233d-02dd-4498-b832-1e622f1023d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036145 Jun 17 08:50:12.953017 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 489/975] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:50:13.344605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:13.345676 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:13.354257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:13.354761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:13.355623 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:13.356234 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:13.588861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:13.597094 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6f0790b2-391c-4e18-82b7-9a295b7cd945 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1615 microversion: 2.1 time: 0.257667 Jun 17 08:50:13.597888 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 487/976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:13 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1615 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:13.778885 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-4bcd06a9-184b-4be7-8916-34fdaf97980e req-d06a1126-2934-413a-ae02-b24fa2cdce48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e311d6c-6487-46f7-a413-b07f95d91018", "name": "network-vif-deleted", "tag": "fbdbedab-420f-4297-9abe-ffb6d7f1ac0e"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:13.787036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4bcd06a9-184b-4be7-8916-34fdaf97980e req-d06a1126-2934-413a-ae02-b24fa2cdce48 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:13.788178 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-4bcd06a9-184b-4be7-8916-34fdaf97980e req-d06a1126-2934-413a-ae02-b24fa2cdce48 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:13.799378 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-4bcd06a9-184b-4be7-8916-34fdaf97980e req-d06a1126-2934-413a-ae02-b24fa2cdce48 service nova] Creating event network-vif-deleted:fbdbedab-420f-4297-9abe-ffb6d7f1ac0e for instance 0e311d6c-6487-46f7-a413-b07f95d91018 on hv-cinder-80377 Jun 17 08:50:13.805313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-4bcd06a9-184b-4be7-8916-34fdaf97980e req-d06a1126-2934-413a-ae02-b24fa2cdce48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Jun 17 08:50:13.805845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 490/977] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:13.945996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:13.947080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:13.956062 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:13.956540 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:13.957339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:13.957775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:14.098104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:14.120921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:14.120921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:14.120921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8cdec1cd-e4f0-47ca-8e0a-ad915db5ada6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1745 microversion: 2.20 time: 0.169695 Jun 17 08:50:14.121320 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 488/978] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:13 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:14.614821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:14.615690 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:14.622699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:14.623362 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:14.624222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:14.625009 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:14.664023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:14.664480 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:14.664967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'fault' on Instance uuid 0e311d6c-6487-46f7-a413-b07f95d91018 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:50:14.707025 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:14.715586 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-48ef8c42-816c-4a62-be34-5195402abc22 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 200 len: 1332 microversion: 2.1 time: 0.104930 Jun 17 08:50:14.716367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 491/979] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:14 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:15.128453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:15.129075 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:15.137044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:15.137543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:15.138296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:15.138728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:15.268642 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:15.286393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:15.288707 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:15.289904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a72e4739-304f-47dd-9dba-ef0f8eee60c9 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.165428 Jun 17 08:50:15.290449 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 489/980] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:15 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:15.732638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:15.733255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:15.739707 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:15.740154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:15.741591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:15.742031 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:15.755509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 HTTP/1.1 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:50:15.757337 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:50:15.758781 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '0e311d6c-6487-46f7-a413-b07f95d91018'} Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:50:15.759536 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:50:15.761421 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:50:15.763099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:50:15.763099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ef2d1401-b1d0-4de7-a05a-78ad1ff931ed tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 404 len: 111 microversion: 2.1 time: 0.029973 Jun 17 08:50:15.763099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 492/981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:15 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:50:15.767876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d9daad8c-1c42-4504-baa9-dd8bd65a396e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '.version_select at 0x7ff025115280>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:15.949751 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d9daad8c-1c42-4504-baa9-dd8bd65a396e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073759617" status: 202 len: 0 microversion: 2.1 time: 0.185569 Jun 17 08:50:15.950636 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 490/982] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 08:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073759617 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:50:16.309318 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:16.309936 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:16.316960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:16.317464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:16.318240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:16.319410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:16.621018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:16.632833 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:16.649313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:16.649313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d2754f55-9c2c-457e-8e00-98006ab8240c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.331074 Jun 17 08:50:16.650088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 493/983] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:16 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:17.050452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ab496efe-78df-478a-a6ca-fddb87f180da tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: .version_select at 0x7ff0251cec10>, body: {"keypair": {"name": "tempest-keypair-971312821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdscklTq7nLDxWnsXZ5nq6M1O3KPRrFoKiIY37SkOZHMVPCXXCsZZZpok+XCiukRf3LRv5aXSPe2pWIb35LUswI0WldNPS4tm2746EIrdSfp022tCI1+iBS6jhcZltUQg=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:17.066492 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-ab496efe-78df-478a-a6ca-fddb87f180da tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:50:17.072442 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-ab496efe-78df-478a-a6ca-fddb87f180da tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:50:17.201840 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ab496efe-78df-478a-a6ca-fddb87f180da tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155715 Jun 17 08:50:17.202451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 491/984] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:50:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:17.657629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:17.658958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:17.667372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:17.667990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:17.668863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:17.669512 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:17.833880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:17.842977 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:17.844825 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:17.846252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2eb25f7d-f83b-490b-b94f-5102cf319b89 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.193247 Jun 17 08:50:17.857361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 494/985] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:17 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:18.866167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:18.866801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:18.873584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:18.874033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:18.874799 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:18.875232 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:19.007190 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:19.015235 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:19.016761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:19.017913 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b9f5e287-65f8-4441-9b55-57d07cade343 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.157025 Jun 17 08:50:19.018463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 492/986] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:18 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:20.037498 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:20.039035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:20.045711 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:20.046745 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:20.047602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:20.048136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:20.215590 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:20.225098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:20.226910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:20.228108 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ff435995-1b2f-4316-aff8-cc234ea02bca tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.194925 Jun 17 08:50:20.238933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 495/987] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:20 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:20.495002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-829280448", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09b364a3-a026-409b-a21c-0c0c53a97d24"}], "security_groups": [{"name": "tempest-securitygroup--1975011198"}], "key_name": "tempest-keypair-971312821", "user_data": "}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:20.603188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] validate_networks() for [('09b364a3-a026-409b-a21c-0c0c53a97d24', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:50:21.042444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:50:21.043162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:50:21.043743 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:50:21.044371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:50:21.044894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:50:21.054226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:21.054761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:21.055595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:21.056035 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:21.077401 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:50:21.081800 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:50:21.094443 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:50:21.096946 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:50:21.246079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:21.247418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:21.254323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:21.255167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:21.256627 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:21.257350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:21.258582 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1e8796a7-2521-4fb9-81b0-b835532aa103 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.768306 Jun 17 08:50:21.265056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 493/988] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:50:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:50:21.272366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-43b11e41-b40a-47b3-a650-bd0f73515d3e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:21.274701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-43b11e41-b40a-47b3-a650-bd0f73515d3e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:21.381538 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-43b11e41-b40a-47b3-a650-bd0f73515d3e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:21.392105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-43b11e41-b40a-47b3-a650-bd0f73515d3e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1240 microversion: 2.1 time: 0.124752 Jun 17 08:50:21.394955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 494/989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:21 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:21.483961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:21.493737 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:21.495435 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:21.496656 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-31dea10e-35b2-417a-8c23-33ee786d842a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.254373 Jun 17 08:50:21.497205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 496/990] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:21 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:22.414774 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-06c9a48b-4d04-4299-973c-4b4db075ffc5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:22.429883 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-06c9a48b-4d04-4299-973c-4b4db075ffc5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:22.476085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-06c9a48b-4d04-4299-973c-4b4db075ffc5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:22.476085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-06c9a48b-4d04-4299-973c-4b4db075ffc5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1240 microversion: 2.1 time: 0.064851 Jun 17 08:50:22.476085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 495/991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:22 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:22.515257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:22.515868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:22.527023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:22.528860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:22.528860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:22.528860 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:22.675794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:22.687794 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:22.689402 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:22.690816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e544409b-19b1-41fa-bc08-5bf02b6d0186 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.179525 Jun 17 08:50:22.691371 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 497/992] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:22 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:23.497700 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:23.498317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:23.506911 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:23.507468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:23.508263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:23.508759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:23.572277 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:23.580200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-15d7be63-7f49-4d1f-86ca-fb20deb9be8a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1292 microversion: 2.1 time: 0.086362 Jun 17 08:50:23.588200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 496/993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:23 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:23.711567 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:23.712583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:23.721654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:23.722827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:23.723969 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:23.725279 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:23.958288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:23.969521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:23.971131 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:23.972335 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-93f754c6-9a6d-4229-965e-df7f45f63b09 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.266200 Jun 17 08:50:23.973659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 498/994] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:23 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:24.601698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:24.603039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:24.608898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:24.615115 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:24.616239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:24.618041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:24.618789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:24.707754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:24.721213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b5fbd6d0-5049-4041-a7ac-7f621f63a7cc tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1298 microversion: 2.1 time: 0.123817 Jun 17 08:50:24.722201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 497/995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:24 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:24.995195 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:24.995851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:25.011106 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:25.011563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:25.012354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:25.012843 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:25.238110 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:25.249549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:25.251412 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:25.253529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-467f67ee-510a-4b95-a088-03a2896b9633 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.266174 Jun 17 08:50:25.254763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 499/996] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:24 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:25.740055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:25.741305 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:25.748239 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:25.748723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:25.749500 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:25.749942 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:25.892200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:25.900037 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0dc59b71-651d-4f2d-b41a-74f4c5624075 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.163892 Jun 17 08:50:25.900882 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 498/997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:25 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:26.275670 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:26.280564 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:26.285595 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:26.286312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:26.287845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:26.288449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:26.408825 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-ee60326c-9b4f-4813-9203-85a58ed43491 req-c11644bb-b949-4b66-8dfb-82c2588de3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4ed6c8-0526-4508-8ecd-9aed437e6157", "tag": "d4ec6109-23be-4bd9-9ed9-f532a5b52259"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:26.435502 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ee60326c-9b4f-4813-9203-85a58ed43491 req-c11644bb-b949-4b66-8dfb-82c2588de3cf service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:26.436093 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-ee60326c-9b4f-4813-9203-85a58ed43491 req-c11644bb-b949-4b66-8dfb-82c2588de3cf service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:26.453906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-ee60326c-9b4f-4813-9203-85a58ed43491 req-c11644bb-b949-4b66-8dfb-82c2588de3cf service nova] Creating event network-changed:d4ec6109-23be-4bd9-9ed9-f532a5b52259 for instance df4ed6c8-0526-4508-8ecd-9aed437e6157 on hv-cinder-80377 Jun 17 08:50:26.460686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-ee60326c-9b4f-4813-9203-85a58ed43491 req-c11644bb-b949-4b66-8dfb-82c2588de3cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060479 Jun 17 08:50:26.461646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 499/998] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:26.559999 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:26.574073 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:26.577944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:26.580192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fed57476-5201-45e2-9afd-c02497c4303a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.311232 Jun 17 08:50:26.593428 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 500/999] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:26 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:26.919103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:26.919848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:26.926052 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:26.926508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:26.927276 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:26.928396 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:27.163806 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:27.171791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-00e5ba02-da99-44f5-bd6c-6478eef82bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.257965 Jun 17 08:50:27.172925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 500/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:26 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:50:27.600911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:27.601525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:27.603996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:27.608762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:27.609214 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:27.609975 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:27.610469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:27.741193 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:27.749075 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:27.750588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:27.751741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-227f4646-2d11-4e58-acc3-70cfb2195d9e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.155536 Jun 17 08:50:27.752294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 501/1001] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:27 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:28.189869 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:28.190412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:28.197745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:28.198201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:28.198971 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:28.199412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:28.328105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:28.335730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-75cb2967-48e0-4db1-80f2-a33e60a84c31 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.149887 Jun 17 08:50:28.336290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 501/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:28 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:28.771647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:28.772202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:28.778591 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:28.779043 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:28.779800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:28.780237 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:28.914732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:28.922945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:28.924448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:28.925646 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b5e039cc-ad60-43be-9761-940047a2c006 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1740 microversion: 2.20 time: 0.158125 Jun 17 08:50:28.926189 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 502/1003] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:28 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:29.352721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:29.353357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:29.359828 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:29.360275 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:29.361080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:29.361497 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:29.489665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:29.497955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7622c740-a182-4714-8349-e2753bd30630 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.149328 Jun 17 08:50:29.498758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 502/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:29 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:29.944580 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:29.945196 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:29.951811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:29.957232 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:29.957232 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:29.957232 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:30.171313 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:30.179522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:30.181234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:30.182408 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0bfae4c3-c0d3-40f9-9043-58533879a62a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1722 microversion: 2.20 time: 0.241890 Jun 17 08:50:30.182978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 503/1005] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:29 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:30.519087 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:30.519705 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:30.526488 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:30.526973 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:30.527750 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:30.528192 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:30.663985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:30.671676 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9dc73e09-8114-4916-a29a-0eddd655ab6d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.156401 Jun 17 08:50:30.672241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 503/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:30 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:31.201588 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:31.202203 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:31.208732 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:31.209233 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:31.210023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:31.210464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:31.341699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:31.350273 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:31.352110 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:31.353297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-31377784-af22-44a6-ba45-cdda20425c8f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1722 microversion: 2.20 time: 0.155683 Jun 17 08:50:31.353838 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 504/1007] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:31 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:31.688885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:31.689531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:31.691544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:31.697602 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:31.698054 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:31.698832 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:31.699327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:31.831773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:31.840310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-73ea493f-ebf8-432c-91d1-174adabce51a tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.155311 Jun 17 08:50:31.840879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 504/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:31 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:32.371846 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:32.372439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:32.378864 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.379309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:32.380071 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.380520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:32.399431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=100 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:32.509464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:32.517292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:32.518804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:32.519962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-35f92f38-5f6b-4811-b460-89ec9dad776c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1725 microversion: 2.20 time: 0.152072 Jun 17 08:50:32.520525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 505/1009] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:32 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:32.539977 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d40e65a5-fc79-48ae-b677-05a5bf608f35"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:32.541078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:32.544146 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=14 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:32.547824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.548271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:32.549104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.549543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:32.857265 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:32.857985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:32.864730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.866252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:32.866252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:32.866692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:33.003468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:33.011599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-47e836ab-8337-4e99-a043-e28f9473e9fe tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.158186 Jun 17 08:50:33.012165 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 506/1010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:32 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:50:33.039179 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:33.062692 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-db8e03eb-cd00-45bb-9ed2-3d11f5deb713 req-782751f0-0656-4a6b-a5ad-6923fe608871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4ed6c8-0526-4508-8ecd-9aed437e6157", "name": "network-vif-plugged", "status": "completed", "tag": "d4ec6109-23be-4bd9-9ed9-f532a5b52259"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:33.072066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-db8e03eb-cd00-45bb-9ed2-3d11f5deb713 req-782751f0-0656-4a6b-a5ad-6923fe608871 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:33.072594 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-db8e03eb-cd00-45bb-9ed2-3d11f5deb713 req-782751f0-0656-4a6b-a5ad-6923fe608871 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:33.083660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-db8e03eb-cd00-45bb-9ed2-3d11f5deb713 req-782751f0-0656-4a6b-a5ad-6923fe608871 service nova] Creating event network-vif-plugged:d4ec6109-23be-4bd9-9ed9-f532a5b52259 for instance df4ed6c8-0526-4508-8ecd-9aed437e6157 on hv-cinder-80377 Jun 17 08:50:33.088996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-db8e03eb-cd00-45bb-9ed2-3d11f5deb713 req-782751f0-0656-4a6b-a5ad-6923fe608871 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030032 Jun 17 08:50:33.089647 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 507/1011] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:50:33.679627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-eb6e0e3f-b39e-4571-ad67-5ba480ea3352 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.145595 Jun 17 08:50:33.680272 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 505/1012] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 08:50:32 2022] POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments => generated 188 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 08:50:33.796672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:33.797262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:33.803783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:33.804234 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:33.805066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:33.805507 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.028767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:34.029306 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:34.035296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.040517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.040517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.040517 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.169795 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:34.177439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-850f44bb-f12a-4a5f-9a26-d1dd3f816238 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.152691 Jun 17 08:50:34.178290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 506/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:34 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:50:34.501624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0a411b4b-2612-4391-854a-3757b0f25808 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments/d40e65a5-fc79-48ae-b677-05a5bf608f35" status: 202 len: 0 microversion: 2.20 time: 0.710083 Jun 17 08:50:34.502224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 508/1014] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 08:50:33 2022] DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments/d40e65a5-fc79-48ae-b677-05a5bf608f35 => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:50:34.559592 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:34.559887 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:34.565921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.566368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.567130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.567556 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.853050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-88268458-4c1c-48e6-b403-3c8dc6cb1f18 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/action" status: 202 len: 0 microversion: 2.20 time: 0.297680 Jun 17 08:50:34.853658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 507/1015] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 08:50:34 2022] POST /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 08:50:34.861708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:34.862323 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:34.870121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.870710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:34.871486 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:34.871923 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:35.006884 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:35.015347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:35.026572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:35.026572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b221f12c-0d32-47e6-bdcc-60e1d85c256b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1673 microversion: 2.20 time: 0.160274 Jun 17 08:50:35.026572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 509/1016] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:34 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:35.105252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-2b7a1cf4-827e-40cc-b6b9-8fe9556e1e8b req-da3fac9e-327f-4d41-aa7e-adcea164e0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:35.114008 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-2b7a1cf4-827e-40cc-b6b9-8fe9556e1e8b req-da3fac9e-327f-4d41-aa7e-adcea164e0ef service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:35.114451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-2b7a1cf4-827e-40cc-b6b9-8fe9556e1e8b req-da3fac9e-327f-4d41-aa7e-adcea164e0ef service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:35.125345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.compute.server_external_events [req-2b7a1cf4-827e-40cc-b6b9-8fe9556e1e8b req-da3fac9e-327f-4d41-aa7e-adcea164e0ef service nova] Unable to find a host for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4. Dropping event network-vif-unplugged {{(pid=124546) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 08:50:35.126211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-2b7a1cf4-827e-40cc-b6b9-8fe9556e1e8b req-da3fac9e-327f-4d41-aa7e-adcea164e0ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026453 Jun 17 08:50:35.126994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 508/1017] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 08:50:35.194631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:35.195257 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:35.201307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:35.201762 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:35.202529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:35.202989 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:35.377525 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:35.386294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b1c9d7ae-95d9-4d39-b255-dc70e0097863 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1366 microversion: 2.1 time: 0.195582 Jun 17 08:50:35.387055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 510/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:35 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:36.037205 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:36.037713 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:36.044346 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.054303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.054303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.054303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.179371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:36.187784 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:36.189347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:36.190516 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c600eaa6-2fdd-49b3-ba9e-bcf96945f173 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1673 microversion: 2.20 time: 0.157393 Jun 17 08:50:36.192543 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 509/1019] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:36 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:36.403440 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:36.404060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:36.410616 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.411069 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.414274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.414274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.598708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:36.606852 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-86b00b6a-8073-47fc-8a1d-d619ccb6275b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1556 microversion: 2.1 time: 0.207449 Jun 17 08:50:36.607418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 511/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:50:36 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1556 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:50:36.627266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:36.627768 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:36.633948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.634406 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.635174 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:36.635615 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:36.739860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-10b10511-cecf-482c-934f-badafdeda576 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116465 Jun 17 08:50:36.740481 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 510/1021] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:50:36 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:37.210723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:37.211365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:37.217406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:37.217854 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:37.218619 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:37.219053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:37.583249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:37.591782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:37.593334 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:37.594506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fa7c04ff-3e04-46f7-afb7-f7528d50f530 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.388631 Jun 17 08:50:37.595267 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 512/1022] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:37 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:38.439463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-f1fb8224-fa4c-4606-9877-72f7f2a71b07 req-2b8b8040-c49c-4db1-87be-6377a6d4ba9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4ed6c8-0526-4508-8ecd-9aed437e6157", "tag": "d4ec6109-23be-4bd9-9ed9-f532a5b52259"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:38.447765 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-f1fb8224-fa4c-4606-9877-72f7f2a71b07 req-2b8b8040-c49c-4db1-87be-6377a6d4ba9c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:38.449216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-f1fb8224-fa4c-4606-9877-72f7f2a71b07 req-2b8b8040-c49c-4db1-87be-6377a6d4ba9c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:38.459193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-f1fb8224-fa4c-4606-9877-72f7f2a71b07 req-2b8b8040-c49c-4db1-87be-6377a6d4ba9c service nova] Creating event network-changed:d4ec6109-23be-4bd9-9ed9-f532a5b52259 for instance df4ed6c8-0526-4508-8ecd-9aed437e6157 on hv-cinder-80377 Jun 17 08:50:38.464693 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-f1fb8224-fa4c-4606-9877-72f7f2a71b07 req-2b8b8040-c49c-4db1-87be-6377a6d4ba9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029376 Jun 17 08:50:38.465368 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 511/1023] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:38.618460 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:38.620952 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:38.632937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:38.635448 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:38.637780 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:38.639088 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:38.926986 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:38.939330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:38.941548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:38.943094 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-12a227e1-4113-4d80-867b-297a9ab47579 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.331772 Jun 17 08:50:38.944280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 513/1024] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:38 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:39.963425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:39.964211 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:39.972127 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:39.972917 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:39.973941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:39.974459 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:40.196466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:40.207861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:40.209767 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:40.210975 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3c0777a3-dd76-42a5-a6d2-69ed2277139b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.252837 Jun 17 08:50:40.211530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 512/1025] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:39 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:41.229688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:41.230230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:41.237522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:41.237969 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:41.238929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:41.239398 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:41.382099 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:41.392961 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:41.394541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:41.395738 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f1e43bf5-a7a2-4ed7-96f5-4d817e20f272 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.170360 Jun 17 08:50:41.396624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 514/1026] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:41 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:42.415468 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:42.416056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:42.423216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:42.432877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:42.433815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:42.434268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:42.588920 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:42.597333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:42.598854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:42.600897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-339f82ab-a747-4748-a279-d06689b1b86b tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.190292 Jun 17 08:50:42.601456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 513/1027] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:42 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:43.620766 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:43.621634 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:43.629689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:43.630859 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:43.631717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:43.632222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:43.796913 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:43.806338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:43.807927 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:43.809141 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-733648a9-337d-41bc-bf22-083c86109a48 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.192596 Jun 17 08:50:43.809916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 515/1028] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:43 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:44.827589 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:44.828202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:44.839437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:44.839916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:44.840725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:44.841171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:44.996098 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:45.007380 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:45.009165 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:45.010436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9fa1a21a-8d19-4763-8d73-cf3041993258 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.186994 Jun 17 08:50:45.011371 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 514/1029] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:44 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:46.029624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:46.030287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:46.038175 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:46.038628 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:46.039419 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:46.039862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:46.182506 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:46.205458 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:46.207202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:46.208532 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f4415a55-c1a7-486d-b91e-316f94a19472 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.182837 Jun 17 08:50:46.209288 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 516/1030] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:46 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:47.227989 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:47.228614 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:47.235107 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:47.235558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:47.236322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:47.236795 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:47.365604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:47.373487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:47.374980 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:47.376164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-16cdfa22-8481-4365-8a5e-5b24dc3e3325 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.152357 Jun 17 08:50:47.376747 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 515/1031] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:47 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:48.395185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:48.395800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:48.402747 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:48.403200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:48.403963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:48.404399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:48.538688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:48.546940 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:48.551367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:48.551367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4d8db946-f0bf-4303-b550-f68a93eea4f6 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.158373 Jun 17 08:50:48.551367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 517/1032] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:48 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 08:50:49.568708 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:49.569294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:49.575703 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:49.576148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:49.576930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:49.577364 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:49.743362 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:49.751330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:49.752841 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:49.753998 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-09402e81-e002-4c67-9a6a-61bdf8cbc51e tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.189619 Jun 17 08:50:49.754548 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 516/1033] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:49 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:50.773057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:50.773657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:50.780331 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:50.780812 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:50.781572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:50.782004 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:50.913974 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:50.922123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:50.923638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:50.924835 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-df5e7d9f-559f-48c1-afa3-c9bbbe9ed7fe tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.156169 Jun 17 08:50:50.925385 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 518/1034] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:50 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:51.943889 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:51.944696 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:51.951271 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:51.951728 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:51.952519 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:51.952957 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:52.095694 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:52.103925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:52.105463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:52.106653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-ecb1b8ea-4576-461e-ab22-5ba526d08b96 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.167380 Jun 17 08:50:52.107204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 517/1035] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:51 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:53.125060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:53.125719 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:53.132560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:53.133010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:53.133796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:53.134236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:53.267290 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:53.276042 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:53.277630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:53.278799 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2f907451-faef-413d-a69d-c1950aa6c437 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.157801 Jun 17 08:50:53.279351 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 519/1036] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:53 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:54.298429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:54.298951 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:54.306005 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:54.306452 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:54.307204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:54.307638 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:54.438816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:54.446665 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:54.448162 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:54.449347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9a33a65c-20a9-48ef-9c0a-f81eb0d50a4f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.154976 Jun 17 08:50:54.449906 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 518/1037] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:54 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:55.092752 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-c67f2ed2-e611-4e2a-971b-8bbc12a25747 req-3f48cba6-c853-4066-b093-cf7582b3f30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "name": "network-vif-plugged", "status": "completed", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:50:55.101529 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-c67f2ed2-e611-4e2a-971b-8bbc12a25747 req-3f48cba6-c853-4066-b093-cf7582b3f30c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:55.101978 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-c67f2ed2-e611-4e2a-971b-8bbc12a25747 req-3f48cba6-c853-4066-b093-cf7582b3f30c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:55.112824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-c67f2ed2-e611-4e2a-971b-8bbc12a25747 req-3f48cba6-c853-4066-b093-cf7582b3f30c service nova] Creating event network-vif-plugged:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:50:55.118122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-c67f2ed2-e611-4e2a-971b-8bbc12a25747 req-3f48cba6-c853-4066-b093-cf7582b3f30c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029373 Jun 17 08:50:55.118704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 520/1038] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:50:55.469456 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:55.470043 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:55.476791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:55.477247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:55.478020 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:55.478455 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:55.606483 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:55.614818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:55.616514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:55.617681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-22a320d5-4c57-4bca-9c84-355a87e448d3 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.153875 Jun 17 08:50:55.618245 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 519/1039] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:55 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:56.636811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:56.637510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:56.643776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:56.644225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:56.645018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:56.645459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:56.650238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:57.045220 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:57.053670 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:57.055170 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:57.056319 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4a95e22a-f16c-4c02-a4fa-59c173417b3c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.424319 Jun 17 08:50:57.056906 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 521/1040] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:56 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:58.077538 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:58.078161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:58.080766 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=48 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:58.085551 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:58.086010 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:58.086786 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:58.087228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:58.216639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:58.225588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:58.227100 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:58.228284 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-58a33010-6971-4bae-a9b9-c9c375f7d80c tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1731 microversion: 2.20 time: 0.156914 Jun 17 08:50:58.228880 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 520/1041] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:58 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:50:59.246645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:50:59.247211 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:50:59.249669 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=42 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:59.254438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.255007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.256342 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:50:59.256808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:50:59.393056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:59.401079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:59.402584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:50:59.403750 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-04c201cc-c257-4405-b35f-973e4e4bfadf tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1718 microversion: 2.20 time: 0.161155 Jun 17 08:50:59.404300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 522/1042] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:50:59 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:51:32.519753 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:51:32.520449 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 08:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:51:51.302867 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:51.303618 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:51.355402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:51.355921 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:51.362284 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:51.362734 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:51.365763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:51.365763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:51.388159 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d958d501-079a-4fde-ad65-c6fbcd4a1b82 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/ips" status: 200 len: 149 microversion: 2.1 time: 0.090259 Jun 17 08:51:51.388749 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 521/1043] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:51:51 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:54.063377 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b565fabe-433d-44c2-b435-521b0a8ae60d"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:54.064462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:54.066718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:54.067497 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=11 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:54.072465 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.074642 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:54.074642 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.074642 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:54.883201 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.884183 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:54.891722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.892180 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:54.892991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.893448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:54.923257 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9a72df08-f325-431c-9ce6-a9c9f1c9c90a tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044497 Jun 17 08:51:54.930039 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 522/1044] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 08:51:54 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:51:54.981104 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:54.982978 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:54.988054 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.988539 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:54.989314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:54.989754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:55.015569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:51:55.032356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-56d16e8b-5fa3-491d-b738-2605a7d4988f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.972503 Jun 17 08:51:55.033065 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 523/1045] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:51:54 2022] POST /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:55.524640 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c6b47b43-2380-402f-a091-742fbd781c93 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 204 len: 0 microversion: 2.20 time: 0.547082 Jun 17 08:51:55.533907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 523/1046] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 08:51:54 2022] DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 17 08:51:55.536078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:55.536815 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:55.544094 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:55.544563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:55.545377 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:55.545821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:55.676765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:55.684813 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:55.705598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:55.705598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cfb74ca5-91c2-4e09-ad35-7225aebbe5a7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.156719 Jun 17 08:51:55.705598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 524/1047] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:51:55 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:51:56.706646 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:56.707351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:56.714054 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:56.714514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:56.715487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:56.715940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:56.860964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:56.868892 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:56.870984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:56.872147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-55802792-04e6-494b-b7d7-f3bdec6f55e7 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1724 microversion: 2.20 time: 0.169940 Jun 17 08:51:56.872735 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 524/1048] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:51:56 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:51:57.891768 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-7225003a-91a2-4dc0-9300-acf27ca9e9be req-20497a3b-3712-4357-9412-5b5f8d2ff9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fb49a7-1949-4683-ad72-357e0b9b42f4", "name": "network-vif-deleted", "tag": "d6375507-a362-491d-b788-2b1d7bcb7da7"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:51:57.892392 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:57.892800 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:57.901894 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:57.905925 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:57.906055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7225003a-91a2-4dc0-9300-acf27ca9e9be req-20497a3b-3712-4357-9412-5b5f8d2ff9ec service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:57.906055 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-7225003a-91a2-4dc0-9300-acf27ca9e9be req-20497a3b-3712-4357-9412-5b5f8d2ff9ec service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:57.906247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:57.906247 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:57.915785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-7225003a-91a2-4dc0-9300-acf27ca9e9be req-20497a3b-3712-4357-9412-5b5f8d2ff9ec service nova] Creating event network-vif-deleted:d6375507-a362-491d-b788-2b1d7bcb7da7 for instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 on hv-cinder-80377 Jun 17 08:51:57.921429 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-7225003a-91a2-4dc0-9300-acf27ca9e9be req-20497a3b-3712-4357-9412-5b5f8d2ff9ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034469 Jun 17 08:51:57.922274 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 525/1049] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:51:57.980616 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:57.990314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:57.996932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1885c809018b4f0890028ba202aa415b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bdae6c05954d4aa06501fec56a19a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:51:57.996932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-debdde08-b459-440d-a309-8ab9f328a690 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 200 len: 1657 microversion: 2.20 time: 0.105348 Jun 17 08:51:57.996932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 525/1050] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:51:57 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 1657 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 08:51:59.014301 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:59.015100 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:51:59.021668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:59.022104 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:59.022880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:51:59.023347 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:51:59.037461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 HTTP/1.1 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:51:59.039129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:51:59.040894 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '84fb49a7-1949-4683-ad72-357e0b9b42f4'} Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:51:59.043431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:51:59.045922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:51:59.047309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:51:59.047309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-082eca8f-aa91-482a-8ceb-db08dee76814 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 404 len: 111 microversion: 2.20 time: 0.031236 Jun 17 08:51:59.047309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 526/1051] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:51:59 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:51:59.050279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-077e383b-81b6-46a8-81ee-5db063b3a48f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '.version_select at 0x7ff025165550>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:51:59.148292 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-077e383b-81b6-46a8-81ee-5db063b3a48f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735022799" status: 204 len: 0 microversion: 2.20 time: 0.101808 Jun 17 08:51:59.148955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 526/1052] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jun 17 08:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735022799 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 08:52:01.259817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.260320 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:01.266910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.267364 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:01.268129 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.268602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:01.281981 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 HTTP/1.1 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:52:01.283511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.285247 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '84fb49a7-1949-4683-ad72-357e0b9b42f4'} Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:01.286156 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.287602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.289053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:01.289053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-89aaba27-d74d-47dc-bf94-0aaf0b5d1d1f tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 404 len: 111 microversion: 2.20 time: 0.028930 Jun 17 08:52:01.289053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 527/1053] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 08:52:01 2022] DELETE /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:01.294600 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:01.295221 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 84fb49a7-1949-4683-ad72-357e0b9b42f4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:01.302333 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.302789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:01.303563 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:01.304003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:01.317994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 HTTP/1.1 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:52:01.319692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.321379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '84fb49a7-1949-4683-ad72-357e0b9b42f4'} Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:01.322473 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. Jun 17 08:52:01.323979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:01.325789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 84fb49a7-1949-4683-ad72-357e0b9b42f4 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:01.325789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-e5563799-526f-48b0-9e24-502836cc2665 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4" status: 404 len: 111 microversion: 2.20 time: 0.031479 Jun 17 08:52:01.325789 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 527/1054] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:01 2022] GET /compute/v2.1/servers/84fb49a7-1949-4683-ad72-357e0b9b42f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:02.634713 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:02.635217 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:02.641831 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.642286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.643053 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.643495 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.657073 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 HTTP/1.1 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:52:02.658617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.660244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '2bece42f-d5e6-4ee3-a9f0-7fb04719de09'} Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:02.661173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.662710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.664218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:02.664218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-364cd598-2fc2-4596-ae2d-710093faf013 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 404 len: 111 microversion: 2.20 time: 0.029151 Jun 17 08:52:02.664218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 528/1055] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 08:52:02 2022] DELETE /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:02.668865 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:02.670444 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] [instance: 2bece42f-d5e6-4ee3-a9f0-7fb04719de09] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:02.676723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.677202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.677960 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:02.678393 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:02.692016 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] HTTP exception thrown: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Request method failure captured: Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 HTTP/1.1 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD7MkSZyTojsDf7swa43hmpZbUb7uWq1ncISc5sggesQjyIrM6s-vZjvHLMtTMsLcnZXt_c69cHj8IpSP5rFjPqNk1JsJToRoUbQJYkmquiYCmCraFjZc-JqBjuAXKpeRuGaqAQCFsOEhcqWgI_cXnsGRf2i-6CTmeEBpCFkTC7MIvY Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:52:02.693578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/21bdae6c05954d4aa06501fec56a19a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 21bdae6c05954d4aa06501fec56a19a2 Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2032979523 Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 1885c809018b4f0890028ba202aa415b Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2032979523-project Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.695255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '2bece42f-d5e6-4ee3-a9f0-7fb04719de09'} Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:02.696241 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. Jun 17 08:52:02.697757 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:02.699470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] Returning 404 to user: Instance 2bece42f-d5e6-4ee3-a9f0-7fb04719de09 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:02.699470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a8f8d28f-1260-4339-8817-35d3cc6a3f72 tempest-AttachVolumeShelveTestJSON-2032979523 tempest-AttachVolumeShelveTestJSON-2032979523-project] 10.222.0.48 "GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09" status: 404 len: 111 microversion: 2.20 time: 0.030316 Jun 17 08:52:02.699470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 528/1056] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 08:52:02 2022] GET /compute/v2.1/servers/2bece42f-d5e6-4ee3-a9f0-7fb04719de09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:03.609277 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b565fabe-433d-44c2-b435-521b0a8ae60d"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:03.610437 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:03.616785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.621352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.621352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.621352 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.697456 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: POST /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments HTTP/1.1 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 74 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:52:03.699061 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {"volumeAttachment": {"volumeId": "b565fabe-433d-44c2-b435-521b0a8ae60d"}} Jun 17 08:52:03.700897 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'server_id': 'df4ed6c8-0526-4508-8ecd-9aed437e6157', 'body': {'volumeAttachment': {'volumeId': 'b565fabe-433d-44c2-b435-521b0a8ae60d'}}} Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:03.701808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:03.703226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 400 to user: Invalid volume: volume b565fabe-433d-44c2-b435-521b0a8ae60d is already attached to instances: df4ed6c8-0526-4508-8ecd-9aed437e6157 {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-24e2c9d6-44ad-4200-8420-d9d2a6814e52 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096633 Jun 17 08:52:03.704797 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 529/1057] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:52:03 2022] POST /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 08:52:03.764655 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:03.765739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:03.772140 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.772620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.773451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:03.773895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:03.866766 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'services' on Instance uuid df4ed6c8-0526-4508-8ecd-9aed437e6157 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:52:04.169625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c0a0985b-8efc-4706-9724-c855fc257d24 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments/b565fabe-433d-44c2-b435-521b0a8ae60d" status: 202 len: 0 microversion: 2.1 time: 0.403366 Jun 17 08:52:04.169625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 529/1058] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:52:03 2022] DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments/b565fabe-433d-44c2-b435-521b0a8ae60d => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:52:04.174028 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:04.174949 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:04.182549 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.182997 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:04.183754 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:04.184361 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:04.215295 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-8c22181b-c968-4cc0-b372-d353974dc381 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046269 Jun 17 08:52:04.219941 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 530/1059] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:52:04 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:05.229739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:05.230881 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:05.237573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:05.238166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:05.238808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:05.239255 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:05.279753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-8e46a55a-a02a-4e65-9f9f-d2e91838d8f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055714 Jun 17 08:52:05.280639 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 530/1060] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:52:05 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:06.292615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.294730 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.302623 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.303395 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.305222 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.305878 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.343332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0e65d772-0bfd-46e8-a19d-3dda46831bfb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055381 Jun 17 08:52:06.343916 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 531/1061] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:52:06 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:52:06.405344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.406514 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.413503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.413955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.414818 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.415251 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.443745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:52:06.815575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-60b187ae-e11c-484c-aa16-fb1493de9a10 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 204 len: 0 microversion: 2.1 time: 0.414965 Jun 17 08:52:06.816167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 531/1062] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:52:06 2022] DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:52:06.824544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:06.827772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:06.831882 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.832332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.833184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:06.833619 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:06.964001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:06.971638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ed402cd7-3e60-4eb5-8568-545eba7b53ac tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1680 microversion: 2.1 time: 0.150930 Jun 17 08:52:06.972544 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 532/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:06 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:07.989545 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:07.990295 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:07.996935 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.997561 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:07.998340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:07.998783 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:08.145202 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:08.152727 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-98e1f0c9-04a7-4e48-b99f-31dac6429ddf tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1680 microversion: 2.1 time: 0.167364 Jun 17 08:52:08.153329 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 532/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:07 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:09.172300 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:09.172790 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:09.184982 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.185582 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.186083 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.186518 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.322332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:09.331261 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0c2a834f-721d-4981-9968-59851b6578f2 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1680 microversion: 2.1 time: 0.164593 Jun 17 08:52:09.331933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 533/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:09 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:09.783200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-dfe7f745-2100-4cc1-9413-236cb22d8f84 req-c68c7b92-7ae1-408f-b3b4-ae0825b8ddee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4ed6c8-0526-4508-8ecd-9aed437e6157", "name": "network-vif-deleted", "tag": "d4ec6109-23be-4bd9-9ed9-f532a5b52259"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:09.800955 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-dfe7f745-2100-4cc1-9413-236cb22d8f84 req-c68c7b92-7ae1-408f-b3b4-ae0825b8ddee service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:09.803204 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-dfe7f745-2100-4cc1-9413-236cb22d8f84 req-c68c7b92-7ae1-408f-b3b4-ae0825b8ddee service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:09.819759 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-dfe7f745-2100-4cc1-9413-236cb22d8f84 req-c68c7b92-7ae1-408f-b3b4-ae0825b8ddee service nova] Creating event network-vif-deleted:d4ec6109-23be-4bd9-9ed9-f532a5b52259 for instance df4ed6c8-0526-4508-8ecd-9aed437e6157 on hv-cinder-80377 Jun 17 08:52:09.829066 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-dfe7f745-2100-4cc1-9413-236cb22d8f84 req-c68c7b92-7ae1-408f-b3b4-ae0825b8ddee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055412 Jun 17 08:52:09.830137 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 533/1066] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:52:10.351184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:10.352270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:10.361236 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.361706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.362646 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.363092 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.401386 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:10.401850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:10.402559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'fault' on Instance uuid df4ed6c8-0526-4508-8ecd-9aed437e6157 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:52:10.450818 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:10.459298 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-77a39b0c-246a-46df-8da8-c2176fb1700d tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 200 len: 1330 microversion: 2.1 time: 0.113707 Jun 17 08:52:10.459871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 534/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:10 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:11.477524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:11.478310 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:11.487290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:11.487760 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:11.488573 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:11.489281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:11.503469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 HTTP/1.1 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:52:11.505161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:52:11.506819 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'df4ed6c8-0526-4508-8ecd-9aed437e6157'} Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:52:11.507725 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:52:11.509375 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:52:11.510808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:52:11.510808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-29ede233-6cb4-4260-b5ae-16517e84f44f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 404 len: 111 microversion: 2.1 time: 0.033249 Jun 17 08:52:11.510808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 534/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:11 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:11.516751 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-609dc914-4772-453e-8ed6-155fea6230ae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '.version_select at 0x7ff025343dc0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:11.657122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-609dc914-4772-453e-8ed6-155fea6230ae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971312821" status: 202 len: 0 microversion: 2.1 time: 0.145569 Jun 17 08:52:11.657717 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 535/1069] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 08:52:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971312821 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:52:12.817078 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-989be20c-b2bd-4cc8-9c8e-ecd807769220 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: .version_select at 0x7ff025317040>, body: {"keypair": {"name": "tempest-keypair-324057296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWajwgMKi68Mbk3Y98Zzfm0deEkp7ZaBOqrQxbHF0TVCY6Ewez7CgQwjV/qxjXAl07JPgcbyPe8o7mi/0nnX9gZTvXrKFlOjEiyPHDBDF3jJNPUHWwQccfHGVbjna2Rrw=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:12.832244 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-989be20c-b2bd-4cc8-9c8e-ecd807769220 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:52:12.836082 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-989be20c-b2bd-4cc8-9c8e-ecd807769220 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:52:12.920830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-989be20c-b2bd-4cc8-9c8e-ecd807769220 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107496 Jun 17 08:52:12.921466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 535/1070] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:52:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:15.806225 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-241384955", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09b364a3-a026-409b-a21c-0c0c53a97d24"}], "security_groups": [{"name": "tempest-securitygroup--1186405094"}], "key_name": "tempest-keypair-324057296", "user_data": "}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:15.927149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] validate_networks() for [('09b364a3-a026-409b-a21c-0c0c53a97d24', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:52:16.399001 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:52:16.399423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:52:16.399890 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:52:16.400296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:52:16.400729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:52:16.410406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.410854 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.411686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:16.412123 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:16.430639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:52:16.434695 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Getting quotas for user 4779e97de469458792d574e607fd8a1f and project d17a97aafb584c31a3cc404634d95885. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:52:16.445634 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:52:16.447902 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:52:16.579091 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a370c21e-e31e-4a75-8067-190caa9cc279 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.777909 Jun 17 08:52:16.579756 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 536/1071] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:52:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:52:16.591014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-aad8daa9-1bcb-44cf-a0f0-3b43ad121a72 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:16.592278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-aad8daa9-1bcb-44cf-a0f0-3b43ad121a72 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:16.649932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-aad8daa9-1bcb-44cf-a0f0-3b43ad121a72 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:16.657722 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-aad8daa9-1bcb-44cf-a0f0-3b43ad121a72 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1240 microversion: 2.1 time: 0.071722 Jun 17 08:52:16.658281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 536/1072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:16 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:17.675904 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:17.676583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:17.684066 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.685172 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.685945 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:17.686365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:17.745378 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:17.754292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-deae187b-bd19-462e-a86e-bde05694aeb3 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1244 microversion: 2.1 time: 0.082253 Jun 17 08:52:17.754856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 537/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:17 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:18.770970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:18.771675 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:18.778724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.779215 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.779988 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:18.780430 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:18.855077 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:18.864319 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-dac1c875-d21f-495f-be1b-7f059e09a184 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1300 microversion: 2.1 time: 0.097160 Jun 17 08:52:18.865003 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 537/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:18 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:19.882047 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:19.882671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:19.891947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.892425 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:19.893523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:19.893967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.054133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:20.062105 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-420e150e-7a80-41c6-8ea9-6947c00d8e7e tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.183720 Jun 17 08:52:20.068533 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 538/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:19 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:20.747897 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-26b24555-c2a3-46fd-8166-e219a536959d req-1d703014-3b02-4437-b41f-05a166336819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d4e38e-7c71-48a1-acc3-7ae1016017b4", "tag": "7799b456-b7d1-4e14-853e-c0f5e2add29c"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:20.762328 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-26b24555-c2a3-46fd-8166-e219a536959d req-1d703014-3b02-4437-b41f-05a166336819 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:20.763415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-26b24555-c2a3-46fd-8166-e219a536959d req-1d703014-3b02-4437-b41f-05a166336819 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:20.783775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-26b24555-c2a3-46fd-8166-e219a536959d req-1d703014-3b02-4437-b41f-05a166336819 service nova] Creating event network-changed:7799b456-b7d1-4e14-853e-c0f5e2add29c for instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 on hv-cinder-80377 Jun 17 08:52:20.789425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-26b24555-c2a3-46fd-8166-e219a536959d req-1d703014-3b02-4437-b41f-05a166336819 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045089 Jun 17 08:52:20.790439 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 538/1076] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:21.085381 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:21.086305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:21.093699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.094344 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.095122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:21.095559 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:21.282610 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:21.290276 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-402f378a-49ec-48b9-bca4-d61b91a736de tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.214842 Jun 17 08:52:21.290859 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 539/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:21 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:22.309498 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:22.310474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:22.312051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:22.317073 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.317530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.318300 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:22.318739 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:22.458188 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:22.465412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-28008457-cb89-487e-9da9-9c56fec5e09f tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.160877 Jun 17 08:52:22.466632 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 539/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:22 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:23.483433 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:23.484051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:23.490566 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.491021 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.491785 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:23.492219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:23.625471 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:23.634114 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fce50a3e-f9a6-4967-9c61-5366325ba855 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.155194 Jun 17 08:52:23.634687 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 540/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:23 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:24.651302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:24.651914 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:24.660227 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.660724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.661505 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:24.661948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:24.666391 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:24.794983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:24.802230 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bef5435d-4dfb-441b-bb2d-e3d9c72ab329 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.154916 Jun 17 08:52:24.802794 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 540/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:24 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:25.819113 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:25.822863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:25.822863 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.831510 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.832014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.832933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:25.833467 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:25.836396 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.975871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:25.989912 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-730ece9b-cdac-4c05-90e0-1c467722cfb1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.174405 Jun 17 08:52:25.990845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 541/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:25 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:27.009469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:27.010173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:27.012455 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=6 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.018578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.019048 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.019815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.020373 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.154876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:27.162388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a4137855-75c6-4636-ab59-b706735af862 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.157367 Jun 17 08:52:27.162947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 541/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:27 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:27.699481 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.700944 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.821804 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-badec105-e82b-4890-8d5f-fcd578e005d5 req-89ba5146-59ae-4843-b1cc-c84a01cf7c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d4e38e-7c71-48a1-acc3-7ae1016017b4", "name": "network-vif-plugged", "status": "completed", "tag": "7799b456-b7d1-4e14-853e-c0f5e2add29c"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:27.830896 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-badec105-e82b-4890-8d5f-fcd578e005d5 req-89ba5146-59ae-4843-b1cc-c84a01cf7c70 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:27.831460 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-badec105-e82b-4890-8d5f-fcd578e005d5 req-89ba5146-59ae-4843-b1cc-c84a01cf7c70 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:27.844569 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-badec105-e82b-4890-8d5f-fcd578e005d5 req-89ba5146-59ae-4843-b1cc-c84a01cf7c70 service nova] Creating event network-vif-plugged:7799b456-b7d1-4e14-853e-c0f5e2add29c for instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 on hv-cinder-80377 Jun 17 08:52:27.849868 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-badec105-e82b-4890-8d5f-fcd578e005d5 req-89ba5146-59ae-4843-b1cc-c84a01cf7c70 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157029 Jun 17 08:52:27.850466 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 542/1083] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:28.179689 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:28.180302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:28.188113 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.188586 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.189357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:28.189787 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:28.324136 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:28.332539 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5dc24c42-e121-436a-80af-dc741626f51c tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.156662 Jun 17 08:52:28.333102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 542/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:28 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:29.351820 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:29.352866 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:29.362515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.362964 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.363737 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:29.364177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:29.501136 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:29.508436 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4b34c3c3-7c15-48a3-a5c9-88e5851f6a68 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.162041 Jun 17 08:52:29.509023 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 543/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:29 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:30.525944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:30.526475 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:30.533524 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.533974 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.534732 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:30.535166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:30.667288 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:30.676081 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3ce8d9a3-cbb0-4218-8b02-835a3bb72080 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.154084 Jun 17 08:52:30.677021 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 543/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:30 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:31.694522 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:31.695120 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:31.701838 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.702393 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.703054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:31.703541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:31.834248 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:31.841681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-73e9ccd0-e1de-46a3-bc99-936c5d937eab tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.151101 Jun 17 08:52:31.842244 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 544/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:31 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:32.858448 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:32.859089 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:32.866625 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.867070 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:32.867857 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:32.868288 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:33.000225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:33.008166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5d69e35f-9b2b-45ee-acd1-77b325c5c783 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1366 microversion: 2.1 time: 0.153575 Jun 17 08:52:33.009267 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 544/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:32 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:52:34.025660 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:34.026280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:34.032958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.033406 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.034164 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.034599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.166187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:52:34.174875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-7d5db6d2-517e-4df6-b931-b904b5a55173 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1557 microversion: 2.1 time: 0.153252 Jun 17 08:52:34.175430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 545/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:52:34 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:52:34.191669 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:52:34.192195 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:52:34.198163 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.198623 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.199388 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:34.199827 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:34.276313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-023a99fa-014b-434e-80c0-cee97ae13c0b tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089359 Jun 17 08:52:34.276942 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 545/1090] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 08:52:34 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:52:35.288082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-41652394-4475-431c-887d-f60095963f89 req-30c591d9-7e3b-4174-a5f9-e2fbf5b5f04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d4e38e-7c71-48a1-acc3-7ae1016017b4", "tag": "7799b456-b7d1-4e14-853e-c0f5e2add29c"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:52:35.297197 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-41652394-4475-431c-887d-f60095963f89 req-30c591d9-7e3b-4174-a5f9-e2fbf5b5f04a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:52:35.297668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-41652394-4475-431c-887d-f60095963f89 req-30c591d9-7e3b-4174-a5f9-e2fbf5b5f04a service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:52:35.308613 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-41652394-4475-431c-887d-f60095963f89 req-30c591d9-7e3b-4174-a5f9-e2fbf5b5f04a service nova] Creating event network-changed:7799b456-b7d1-4e14-853e-c0f5e2add29c for instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 on hv-cinder-80377 Jun 17 08:52:35.314291 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-41652394-4475-431c-887d-f60095963f89 req-30c591d9-7e3b-4174-a5f9-e2fbf5b5f04a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 Jun 17 08:52:35.314889 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 546/1091] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:39.910987 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aef343ae-9bed-4c0c-8881-4223d5578fa5] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 08:53:39.913919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=13 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:39.913919 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=32 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:39.916766 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:39.917764 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:39.924056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:39.924542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:39.925313 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:39.925753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:39.949035 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-791e27a0-56f1-4c24-b110-14e2841e1807 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039759 Jun 17 08:53:39.949662 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 546/1092] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 08:53:39 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:41.524871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=11 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:41.525609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=27 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:41.530769 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a88176a0-004c-476f-9d58-758b3d717059"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:41.531922 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:41.537909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.538509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:41.539281 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:41.539723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:42.258434 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f5d70d1e-ca7e-4bf2-86a1-dfd498dd9d04 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "POST /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735392 Jun 17 08:53:42.259111 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 547/1093] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:53:41 2022] POST /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:49.836780 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:49.837322 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:49.847281 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:49.847738 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:49.848570 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:49.849014 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:49.853667 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] [aef343ae-9bed-4c0c-8881-4223d5578fa5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38624. Jun 17 08:53:49.931633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'services' on Instance uuid e6d4e38e-7c71-48a1-acc3-7ae1016017b4 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:53:50.158581 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-00182fe0-e4d6-4fbb-9093-e30723dd6489 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments/a88176a0-004c-476f-9d58-758b3d717059" status: 202 len: 0 microversion: 2.1 time: 0.325649 Jun 17 08:53:50.162677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 547/1094] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:53:49 2022] DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments/a88176a0-004c-476f-9d58-758b3d717059 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:53:50.169367 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:50.170696 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:50.176917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:50.179103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:50.179103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:50.179103 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:50.208469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a171ca34-e816-41bf-b171-3007fc5a38fb tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Jun 17 08:53:50.209058 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 548/1095] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:53:50 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:51.221523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:51.222644 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:51.229307 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.229754 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.230508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:51.231788 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:51.260430 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-3a280e69-f120-47f6-a44b-68269285a1d1 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Jun 17 08:53:51.261006 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 548/1096] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:53:51 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:52.273827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:52.274667 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:52.281499 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.281958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.282725 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.283163 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.312441 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-da2f50a1-b958-4368-b9e9-3f5a235a9fa6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042754 Jun 17 08:53:52.313014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 549/1097] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:53:52 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 08:53:52.369070 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:52.369568 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:52.376848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.377305 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.378067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.378509 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.405365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:53:52.757544 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-33f1d9b3-da2c-4eb7-96c8-de69156d6327 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 204 len: 0 microversion: 2.1 time: 0.391979 Jun 17 08:53:52.758168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 549/1098] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:53:52 2022] DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:53:52.766568 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:52.769349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:52.774000 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.774476 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.775239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:52.775674 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:52.910638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:52.918093 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f84692ae-144b-4d3e-bc3c-e6ddc162fe07 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1681 microversion: 2.1 time: 0.155651 Jun 17 08:53:52.918659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 550/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:52 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:53.936508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:53.937225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:53.943732 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:53.944185 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:53.944991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:53.945433 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:54.076533 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:54.083984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-34ae0c5a-4380-464f-8c11-6d5bee948c53 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1681 microversion: 2.1 time: 0.152468 Jun 17 08:53:54.084554 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 550/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:53 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:55.101354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:55.102144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:55.108917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:55.111287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.111287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:55.111287 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.249680 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:55.257147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-74b74635-dc5d-43e9-b0d1-5b98a3718cde tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1681 microversion: 2.1 time: 0.159839 Jun 17 08:53:55.257963 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 551/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:55 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:55.835262 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-1cf07af1-c855-4de9-9388-f170fe608ba3 req-a4883491-c5a2-40ee-b711-c00e549e1971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d4e38e-7c71-48a1-acc3-7ae1016017b4", "name": "network-vif-deleted", "tag": "7799b456-b7d1-4e14-853e-c0f5e2add29c"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:53:55.846450 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1cf07af1-c855-4de9-9388-f170fe608ba3 req-a4883491-c5a2-40ee-b711-c00e549e1971 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:55.846896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-1cf07af1-c855-4de9-9388-f170fe608ba3 req-a4883491-c5a2-40ee-b711-c00e549e1971 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:55.865311 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-1cf07af1-c855-4de9-9388-f170fe608ba3 req-a4883491-c5a2-40ee-b711-c00e549e1971 service nova] Creating event network-vif-deleted:7799b456-b7d1-4e14-853e-c0f5e2add29c for instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 on hv-cinder-80377 Jun 17 08:53:55.871469 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-1cf07af1-c855-4de9-9388-f170fe608ba3 req-a4883491-c5a2-40ee-b711-c00e549e1971 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242529 Jun 17 08:53:55.871928 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 551/1102] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:53:56.275181 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:56.275811 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:56.283038 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.283491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.285401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.285858 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.319688 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:56.320142 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:56.320621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lazy-loading 'fault' on Instance uuid e6d4e38e-7c71-48a1-acc3-7ae1016017b4 {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:53:56.364596 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4779e97de469458792d574e607fd8a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17a97aafb584c31a3cc404634d95885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:53:56.372238 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-86ea7f41-9c50-4c34-8eda-0645eedd7fa8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 200 len: 1330 microversion: 2.1 time: 0.100915 Jun 17 08:53:56.372850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 552/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:56 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:53:57.389096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:57.389796 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:57.396566 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:57.397019 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:57.397777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:57.398213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:57.412125 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 HTTP/1.1 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:53:57.413773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:57.415569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'e6d4e38e-7c71-48a1-acc3-7ae1016017b4'} Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:53:57.416528 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:57.418161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:57.420431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:53:57.420431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f2d8d00d-3067-4a58-8592-47ab12e0f5c6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 404 len: 111 microversion: 2.1 time: 0.030448 Jun 17 08:53:57.420431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 552/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:57 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:53:57.425202 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aa57d519-52af-4fa5-8c59-b22c9530cfd6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '.version_select at 0x7ff0250d73a0>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:57.506817 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aa57d519-52af-4fa5-8c59-b22c9530cfd6 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324057296" status: 202 len: 0 microversion: 2.1 time: 0.085326 Jun 17 08:53:57.507389 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 553/1105] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 08:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324057296 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:53:59.638447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:59.638944 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:59.645436 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.645929 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.646691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.647128 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.661217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 HTTP/1.1 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:53:59.662758 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.664429 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'e6d4e38e-7c71-48a1-acc3-7ae1016017b4'} Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:53:59.665334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.666684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.668023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:53:59.668023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cf836d52-f9ce-42f9-867c-6a869a907332 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 404 len: 111 microversion: 2.1 time: 0.029667 Jun 17 08:53:59.668023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 553/1106] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:53:59 2022] DELETE /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:53:59.674388 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:53:59.675036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: e6d4e38e-7c71-48a1-acc3-7ae1016017b4] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:53:59.681842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.682325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.683138 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:53:59.683575 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:53:59.696681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 HTTP/1.1 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:53:59.698370 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.699962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'e6d4e38e-7c71-48a1-acc3-7ae1016017b4'} Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:53:59.701182 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. Jun 17 08:53:59.702668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:53:59.704090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance e6d4e38e-7c71-48a1-acc3-7ae1016017b4 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:53:59.704090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-2cf643f4-8e4e-4079-b8bb-7e7f784f26f5 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4" status: 404 len: 111 microversion: 2.1 time: 0.030925 Jun 17 08:53:59.704090 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 554/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:53:59 2022] GET /compute/v2.1/servers/e6d4e38e-7c71-48a1-acc3-7ae1016017b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:01.017554 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.018069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.024549 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.024997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.025746 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.026178 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.040123 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 HTTP/1.1 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:54:01.041698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.043381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': 'df4ed6c8-0526-4508-8ecd-9aed437e6157'} Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:01.045207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.046801 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.048633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:01.048633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fd2de115-f785-4c68-8f15-c1124f90e555 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 404 len: 111 microversion: 2.1 time: 0.029871 Jun 17 08:54:01.048633 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 554/1108] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:54:01 2022] DELETE /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:01.052554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.053174 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: df4ed6c8-0526-4508-8ecd-9aed437e6157] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.059621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.060239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.060836 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.061299 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.074356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 HTTP/1.1 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:54:01.075910 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.077545 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'df4ed6c8-0526-4508-8ecd-9aed437e6157'} Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:01.078548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. Jun 17 08:54:01.080018 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.081380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance df4ed6c8-0526-4508-8ecd-9aed437e6157 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:01.081380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-280c9440-55ef-44eb-8128-0a950bf057ff tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157" status: 404 len: 111 microversion: 2.1 time: 0.028652 Jun 17 08:54:01.081380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 555/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:01 2022] GET /compute/v2.1/servers/df4ed6c8-0526-4508-8ecd-9aed437e6157 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:01.085808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.086308 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.092983 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.093438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.094216 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.094658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.108381 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd HTTP/1.1 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:54:01.109937 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.111511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '2d442aa1-cf7a-41a5-8a63-933e148bd8cd'} Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:01.112547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.114064 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.115626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:01.115626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d1e0375b-e4da-4dbe-b468-098403b05722 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 404 len: 111 microversion: 2.1 time: 0.029454 Jun 17 08:54:01.115626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 555/1110] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:54:01 2022] DELETE /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:01.119658 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:01.120303 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 2d442aa1-cf7a-41a5-8a63-933e148bd8cd] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:01.126410 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.126862 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.127617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:01.128101 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:01.141308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd HTTP/1.1 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:54:01.142800 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.144349 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '2d442aa1-cf7a-41a5-8a63-933e148bd8cd'} Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:01.145340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. Jun 17 08:54:01.146791 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:01.148155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 2d442aa1-cf7a-41a5-8a63-933e148bd8cd could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:01.148155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-fe584a77-9e71-41e5-9254-b3895c372aae tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd" status: 404 len: 111 microversion: 2.1 time: 0.028545 Jun 17 08:54:01.148155 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 556/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:01 2022] GET /compute/v2.1/servers/2d442aa1-cf7a-41a5-8a63-933e148bd8cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:02.414898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:02.415402 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:02.422102 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.422565 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.423334 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.423780 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.437463 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 HTTP/1.1 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:54:02.438993 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.440729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '0e311d6c-6487-46f7-a413-b07f95d91018'} Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:02.441791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.443290 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.444903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:02.444903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-67442681-b7fd-4ad6-8409-4b0d171213f8 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 404 len: 111 microversion: 2.1 time: 0.029345 Jun 17 08:54:02.444903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 556/1112] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:54:02 2022] DELETE /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:02.448681 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:02.449294 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] [instance: 0e311d6c-6487-46f7-a413-b07f95d91018] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:02.456683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.457125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.457874 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:02.458302 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:02.474830 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] HTTP exception thrown: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Request method failure captured: Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 HTTP/1.1 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirD9dSsL0MrrjGEKuGytihtGgEgknLceqxsbCpiakL4ZTid-1JNkDKfUFYKkgciAepnvBDnFNxG7muQD9pL6WnfxjfcwYvtQp68x8FslKKPgcklfNIJF3d4qk_PQcLUsLPH7O6g8ZrmS7BVlEVQ0xofuic2s7iRAmn_f-YMYHX7z7Q9w Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:54:02.476379 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d17a97aafb584c31a3cc404634d95885"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d17a97aafb584c31a3cc404634d95885"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: d17a97aafb584c31a3cc404634d95885 Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-99763009 Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 4779e97de469458792d574e607fd8a1f Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-AttachVolumeNegativeTest-99763009-project Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.478067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '0e311d6c-6487-46f7-a413-b07f95d91018'} Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:54:02.479127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. Jun 17 08:54:02.480645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:54:02.482127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] Returning 404 to user: Instance 0e311d6c-6487-46f7-a413-b07f95d91018 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:54:02.482127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4bc648f8-ea81-4bfe-b5bd-097a9208a082 tempest-AttachVolumeNegativeTest-99763009 tempest-AttachVolumeNegativeTest-99763009-project] 10.222.0.48 "GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018" status: 404 len: 111 microversion: 2.1 time: 0.032963 Jun 17 08:54:02.482127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 557/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:02 2022] GET /compute/v2.1/servers/0e311d6c-6487-46f7-a413-b07f95d91018 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:52.787479 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1544565858", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "networks": [{"uuid": "b4b7dc09-91c3-4deb-8b9a-c68eacbeeaf0"}]}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:54:52.795350 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:52.796045 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:52.846266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.network.neutron [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] validate_networks() for [('b4b7dc09-91c3-4deb-8b9a-c68eacbeeaf0', None, None, None, None, None)] {{(pid=124546) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:54:53.251181 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Flavor limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:54:53.251606 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Image limits 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:54:53.252079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Flavor pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:54:53.252506 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Image pref 0:0:0 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:54:53.252927 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.virt.hardware [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:54:53.262916 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.263361 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.264160 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:53.264664 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:53.280948 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Getting quotas for project 06929b24e45545439cc33e50894ce607. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:54:53.284791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Getting quotas for user 7251818efb8e43bc90902302f7b482f8 and project 06929b24e45545439cc33e50894ce607. Resources: {'cores', 'ram', 'instances'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:54:53.295413 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Going to run 1 instances... {{(pid=124546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:54:53.297951 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:54:53.501753 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [43c88378-7c7d-4343-bcda-d0a0255507d9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 08:54:54.510131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [43c88378-7c7d-4343-bcda-d0a0255507d9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39146. Jun 17 08:54:54.514033 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cd4e219f-663f-46c6-8a9a-90453fd4469b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732715 Jun 17 08:54:54.514963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 557/1114] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 08:54:54.525218 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-1be17082-78e3-4d73-a1ed-7373cb3fddde tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:54.525839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-1be17082-78e3-4d73-a1ed-7373cb3fddde tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:54.528184 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:54.528880 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:54.581332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-1be17082-78e3-4d73-a1ed-7373cb3fddde tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:54.588996 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-1be17082-78e3-4d73-a1ed-7373cb3fddde tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1214 microversion: 2.1 time: 0.067705 Jun 17 08:54:54.592102 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 558/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:54 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:55.606353 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-961859f6-877c-402f-b0a9-b6484539ea47 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:55.607053 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-961859f6-877c-402f-b0a9-b6484539ea47 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:55.664270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-961859f6-877c-402f-b0a9-b6484539ea47 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:55.671253 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-961859f6-877c-402f-b0a9-b6484539ea47 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1214 microversion: 2.1 time: 0.069361 Jun 17 08:54:55.671825 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 558/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:55 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:56.689015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b63e805-9c7f-4034-8cc1-fbaf79d23317 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:56.689708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b63e805-9c7f-4034-8cc1-fbaf79d23317 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:56.743879 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b63e805-9c7f-4034-8cc1-fbaf79d23317 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:56.751601 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b63e805-9c7f-4034-8cc1-fbaf79d23317 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1214 microversion: 2.1 time: 0.066303 Jun 17 08:54:56.752148 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 559/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:56 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:57.769109 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5dc19033-01ac-4868-86ed-8e03ad7da0f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:57.770130 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5dc19033-01ac-4868-86ed-8e03ad7da0f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:57.825017 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5dc19033-01ac-4868-86ed-8e03ad7da0f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:57.831699 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5dc19033-01ac-4868-86ed-8e03ad7da0f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1214 microversion: 2.1 time: 0.066956 Jun 17 08:54:57.832266 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 559/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:57 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:58.852834 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:58.853482 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:58.860019 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.860474 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.861266 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:58.861706 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:58.925213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:54:58.932772 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b4de10b-3172-44cd-85bc-e9fcb500b156 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1218 microversion: 2.1 time: 0.084325 Jun 17 08:54:58.933330 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 560/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:58 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:54:59.950226 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:54:59.950842 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:54:59.957446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.957893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:54:59.958652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:54:59.959088 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:00.024964 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:00.032522 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-2e0c5df6-fe8e-4a27-b9d6-409eaa22ed89 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1218 microversion: 2.1 time: 0.086374 Jun 17 08:55:00.033085 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 560/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:54:59 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:01.049784 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:01.050422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:01.058400 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.063626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.063626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:01.063626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:01.122821 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:01.130307 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a2c7b26e-69fd-43ea-9d9a-71c30ba45ca1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1272 microversion: 2.1 time: 0.084713 Jun 17 08:55:01.130917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 561/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:01 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:02.147272 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:02.147961 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:02.154569 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.155026 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.155792 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.156229 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.292590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:02.301291 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-afe7989d-1bac-4b4a-bb89-01ec489028d3 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.157929 Jun 17 08:55:02.301854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 561/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:02 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:02.406621 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-79563396-169a-469e-902f-e737ec0cd3f9 req-47bb08da-fb65-46d1-8ce6-899b397b2577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9f4614-9907-48ed-ae25-98a1b82e91ea", "tag": "c2cc73af-1f17-4b47-b00a-b1481d8acd89"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:02.416115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-79563396-169a-469e-902f-e737ec0cd3f9 req-47bb08da-fb65-46d1-8ce6-899b397b2577 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:02.417173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-79563396-169a-469e-902f-e737ec0cd3f9 req-47bb08da-fb65-46d1-8ce6-899b397b2577 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:02.427563 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-79563396-169a-469e-902f-e737ec0cd3f9 req-47bb08da-fb65-46d1-8ce6-899b397b2577 service nova] Creating event network-changed:c2cc73af-1f17-4b47-b00a-b1481d8acd89 for instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea on hv-cinder-80377 Jun 17 08:55:02.433672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-79563396-169a-469e-902f-e737ec0cd3f9 req-47bb08da-fb65-46d1-8ce6-899b397b2577 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Jun 17 08:55:02.434272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 562/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:03.319242 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:03.320400 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:03.322650 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:03.327493 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.327947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.328745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:03.329194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:03.461656 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:03.469153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cf7c6f12-d471-4935-b272-4739cc2fc2f4 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.153901 Jun 17 08:55:03.469721 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 562/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:03 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:04.487368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:04.488078 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:04.494630 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.495089 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.495853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:04.496296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:04.625652 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:04.633645 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c74b5449-203e-4aa5-b91c-1bdf3b2eb710 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.150975 Jun 17 08:55:04.634205 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 563/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:04 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:05.650370 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:05.651002 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:05.657420 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.661627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.661627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:05.661627 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:05.786905 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:05.794992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a901ae18-fdce-4328-8d36-0f669d1f2faa tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.149173 Jun 17 08:55:05.796363 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 563/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:05 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:06.812119 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:06.812853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:06.815292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=4 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:06.820914 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.821221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.822077 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:06.822519 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:06.961320 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:06.968994 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-41e49281-03dd-4b53-8ec8-f8744107edfd tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.160680 Jun 17 08:55:06.969815 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 564/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:06 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:07.986432 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:07.987044 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:07.989359 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=10 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:07.994203 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.994655 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:07.995424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:07.995862 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.123677 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:08.131086 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-bcf5647f-c469-4713-8be6-ba2a90013807 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.148529 Jun 17 08:55:08.131654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 564/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:07 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:08.592144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-6102f0cc-d24b-4986-a8be-665d7d53d288 req-0735db65-fc33-4099-9a5f-f00f3658b86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9f4614-9907-48ed-ae25-98a1b82e91ea", "name": "network-vif-plugged", "status": "completed", "tag": "c2cc73af-1f17-4b47-b00a-b1481d8acd89"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:08.600697 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6102f0cc-d24b-4986-a8be-665d7d53d288 req-0735db65-fc33-4099-9a5f-f00f3658b86b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:08.601272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-6102f0cc-d24b-4986-a8be-665d7d53d288 req-0735db65-fc33-4099-9a5f-f00f3658b86b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:08.612183 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-6102f0cc-d24b-4986-a8be-665d7d53d288 req-0735db65-fc33-4099-9a5f-f00f3658b86b service nova] Creating event network-vif-plugged:c2cc73af-1f17-4b47-b00a-b1481d8acd89 for instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea on hv-cinder-80377 Jun 17 08:55:08.617845 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-6102f0cc-d24b-4986-a8be-665d7d53d288 req-0735db65-fc33-4099-9a5f-f00f3658b86b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029212 Jun 17 08:55:08.618423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 565/1129] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:09.148385 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:09.149057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:09.155605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.156057 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.156904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:09.157292 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:09.291422 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:09.299161 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4ebc56ea-9da6-4445-a70b-971c1807cab1 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.154912 Jun 17 08:55:09.299724 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 565/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:09 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:10.322523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:10.323776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:10.331087 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.331560 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.332309 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:10.332773 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:10.463261 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:10.470634 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a97df3d1-cf0a-4e94-9e45-55b3d7d5dcbe tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1314 microversion: 2.1 time: 0.157385 Jun 17 08:55:10.471199 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 566/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:10 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:55:11.487106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:11.487718 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:11.494807 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:11.495268 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:11.496025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:11.496458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:11.627118 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:11.634590 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4fe0c112-df4b-4dcc-8498-55f33d97cd38 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1499 microversion: 2.1 time: 0.151373 Jun 17 08:55:11.635152 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 566/1132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:11 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:12.369462 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:12.370511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:12.378807 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.379583 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.382085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.382085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.410446 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:55:12.811571 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-72932c7b-cc5a-4ba8-8eea-bc5bf8fa3640 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 204 len: 0 microversion: 2.1 time: 0.445665 Jun 17 08:55:12.812241 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 567/1133] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:55:12 2022] DELETE /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:55:12.822224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:12.822909 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:12.830249 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.830852 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.832207 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:12.832994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:12.992318 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:13.001947 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0ad677ec-9837-44e8-987c-aa22d1146932 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1505 microversion: 2.1 time: 0.184956 Jun 17 08:55:13.002610 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 567/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:12 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:14.021964 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:14.022655 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:14.029839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.030280 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.031035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.031468 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.167535 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:14.175439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d11183fa-f920-4001-b025-9e7f63c545ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1505 microversion: 2.1 time: 0.157712 Jun 17 08:55:14.175937 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 568/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:14 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:14.880791 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-384e17fa-43ad-4241-8ada-7c24f1ca86ed req-081fa2ae-9d17-499f-b68c-9161396764f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9f4614-9907-48ed-ae25-98a1b82e91ea", "name": "network-vif-deleted", "tag": "c2cc73af-1f17-4b47-b00a-b1481d8acd89"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:14.890213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-384e17fa-43ad-4241-8ada-7c24f1ca86ed req-081fa2ae-9d17-499f-b68c-9161396764f0 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:14.890854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-384e17fa-43ad-4241-8ada-7c24f1ca86ed req-081fa2ae-9d17-499f-b68c-9161396764f0 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:14.904844 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-384e17fa-43ad-4241-8ada-7c24f1ca86ed req-081fa2ae-9d17-499f-b68c-9161396764f0 service nova] Creating event network-vif-deleted:c2cc73af-1f17-4b47-b00a-b1481d8acd89 for instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea on hv-cinder-80377 Jun 17 08:55:14.910148 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-384e17fa-43ad-4241-8ada-7c24f1ca86ed req-081fa2ae-9d17-499f-b68c-9161396764f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033368 Jun 17 08:55:14.910816 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 568/1136] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:15.192839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:15.193461 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:15.201052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.201511 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.202272 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.202724 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.234615 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:15.235259 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:15.235716 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.objects.instance [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lazy-loading 'fault' on Instance uuid 6f9f4614-9907-48ed-ae25-98a1b82e91ea {{(pid=124545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:55:15.285154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:15.292795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-cc84a7fc-b6e1-45aa-bb3b-bd845052e09b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 200 len: 1304 microversion: 2.1 time: 0.104011 Jun 17 08:55:15.293355 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 569/1137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:15 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:16.311304 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:16.311923 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: 6f9f4614-9907-48ed-ae25-98a1b82e91ea] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:16.318330 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.318785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.319553 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.319986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.334873 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] HTTP exception thrown: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Request method failure captured: Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea HTTP/1.1 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirEFaCSq7a3GrqolgaVqMqpUk-n16M78q4SxBVUuyKuDKiNqDJv7hiZjdaWyjUBsHUsKWi7ZZKHGGFx2KYkSREbs4bTNWyLzjKEAt-mRPUD-YXxfuyp9KKlPzz6krBHveuDnJCTQwdcO9OLmMKA62bClC_MbhNSUMxFBaPA8xoybwBvs Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: 06929b24e45545439cc33e50894ce607 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-VolumesActionsTest-523296744 Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:55:16.336530 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06929b24e45545439cc33e50894ce607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06929b24e45545439cc33e50894ce607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06929b24e45545439cc33e50894ce607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06929b24e45545439cc33e50894ce607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-VolumesActionsTest-523296744 Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: 06929b24e45545439cc33e50894ce607 Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-VolumesActionsTest-523296744 Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-VolumesActionsTest-523296744-project Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: 7251818efb8e43bc90902302f7b482f8 Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-VolumesActionsTest-523296744-project Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. Jun 17 08:55:16.338296 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'id': '6f9f4614-9907-48ed-ae25-98a1b82e91ea'} Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:55:16.340531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. Jun 17 08:55:16.342260 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:55:16.343752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Returning 404 to user: Instance 6f9f4614-9907-48ed-ae25-98a1b82e91ea could not be found. {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:55:16.343752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d796d0a0-a992-4a2c-bc27-c02c4d82681c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea" status: 404 len: 111 microversion: 2.1 time: 0.032426 Jun 17 08:55:16.343752 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 569/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:16 2022] GET /compute/v2.1/servers/6f9f4614-9907-48ed-ae25-98a1b82e91ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:55:16.393362 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674321772", "imageRef": "25f5365a-b3ab-44b1-a6ca-ce8344783403", "flavorRef": "452", "networks": [{"uuid": "b4b7dc09-91c3-4deb-8b9a-c68eacbeeaf0"}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:16.444729 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] validate_networks() for [('b4b7dc09-91c3-4deb-8b9a-c68eacbeeaf0', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:55:16.791052 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:55:16.791469 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:55:16.791965 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:55:16.792763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:55:16.793332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:55:16.802368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.802805 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.803589 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:16.804021 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:16.820962 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Getting quotas for project 06929b24e45545439cc33e50894ce607. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:55:16.825788 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Getting quotas for user 7251818efb8e43bc90902302f7b482f8 and project 06929b24e45545439cc33e50894ce607. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:55:16.836803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:55:16.844818 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25f5365a-b3ab-44b1-a6ca-ce8344783403',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:55:16.989474 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-caa6b38f-8ae1-458a-a0ca-7946e0cd39a0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599899 Jun 17 08:55:16.990305 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 570/1139] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:55:17.000911 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-b3bb8f7b-b31b-44b9-a228-df95ba049410 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:17.001534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-b3bb8f7b-b31b-44b9-a228-df95ba049410 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:17.056820 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-b3bb8f7b-b31b-44b9-a228-df95ba049410 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:17.064781 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-b3bb8f7b-b31b-44b9-a228-df95ba049410 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1214 microversion: 2.1 time: 0.068120 Jun 17 08:55:17.065356 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 570/1140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:16 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:18.083185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:18.087015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:18.091186 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.091637 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.092413 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:18.092875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:18.154686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:18.162067 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-30d7b63d-ca70-48fb-8bb8-1b66c2bc80e6 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1210 microversion: 2.1 time: 0.083278 Jun 17 08:55:18.162639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 571/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:18 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:19.182872 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:19.188845 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:19.192701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.193158 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.193932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:19.194370 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:19.260466 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:19.268775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-159042d3-eb57-419d-8ce4-74c7b173049b tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1272 microversion: 2.1 time: 0.089857 Jun 17 08:55:19.269357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 571/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:19 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:20.289430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:20.289430 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:20.293464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.293971 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.294907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.295348 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.430329 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:20.438311 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-b5a27e2f-d43b-4866-9663-c8f307e18f26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.156169 Jun 17 08:55:20.438977 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 572/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:20 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:20.479997 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-af855189-1e8d-4595-bed7-21a84fcbddf9 req-ada0c5cc-45a1-4133-a717-16f21235d064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa727284-0146-40af-8dca-26bd48b90cb8", "tag": "e9250e3a-abdf-4937-94be-280537dbafc1"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:20.488537 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-af855189-1e8d-4595-bed7-21a84fcbddf9 req-ada0c5cc-45a1-4133-a717-16f21235d064 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:20.488992 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-af855189-1e8d-4595-bed7-21a84fcbddf9 req-ada0c5cc-45a1-4133-a717-16f21235d064 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:20.501763 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-af855189-1e8d-4595-bed7-21a84fcbddf9 req-ada0c5cc-45a1-4133-a717-16f21235d064 service nova] Creating event network-changed:e9250e3a-abdf-4937-94be-280537dbafc1 for instance aa727284-0146-40af-8dca-26bd48b90cb8 on hv-cinder-80377 Jun 17 08:55:20.507173 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-af855189-1e8d-4595-bed7-21a84fcbddf9 req-ada0c5cc-45a1-4133-a717-16f21235d064 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030608 Jun 17 08:55:20.507776 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 572/1144] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:55:21.455185 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:21.455789 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:21.462479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.462926 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.463682 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:21.464115 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:21.594268 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:21.601602 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-058f58f3-76a3-494d-aab3-3e47d7a43fbb tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.150223 Jun 17 08:55:21.602158 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 573/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:21 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:22.618979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:22.619595 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:22.627200 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.627652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.628417 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:22.628890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:22.762164 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:22.769626 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9acaa5fc-d163-4244-a4d4-a9ebeec8219d tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.154980 Jun 17 08:55:22.770194 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 573/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:22 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:23.787458 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:23.788150 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:23.794683 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.795132 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.795899 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:23.796338 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:23.932210 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:23.940710 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f79cd8a1-0e32-4de1-a682-ea918c09dd66 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.157132 Jun 17 08:55:23.941263 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 574/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:23 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:24.957558 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:24.958083 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:24.960631 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:24.965394 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.966424 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.967470 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:24.967904 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:24.970447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=69 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:25.103661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:25.111167 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-56d69ddb-53cd-4456-b488-287dcdfe278c tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.157481 Jun 17 08:55:25.111766 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 574/1148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:24 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:26.130531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:26.131173 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:26.138292 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.138764 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.139498 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.139933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.269672 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:26.277127 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-54f7c8a9-e4c1-4318-9a74-ea43859ea698 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.150446 Jun 17 08:55:26.277686 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 575/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:26 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:26.630135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-126ea95b-7e15-4ac6-8d09-efa518c07f26 req-5adeaf87-bb72-4244-82c5-6311b0dd26ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa727284-0146-40af-8dca-26bd48b90cb8", "name": "network-vif-plugged", "status": "completed", "tag": "e9250e3a-abdf-4937-94be-280537dbafc1"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:26.639575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-126ea95b-7e15-4ac6-8d09-efa518c07f26 req-5adeaf87-bb72-4244-82c5-6311b0dd26ae service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:26.640051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-126ea95b-7e15-4ac6-8d09-efa518c07f26 req-5adeaf87-bb72-4244-82c5-6311b0dd26ae service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:26.651309 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-126ea95b-7e15-4ac6-8d09-efa518c07f26 req-5adeaf87-bb72-4244-82c5-6311b0dd26ae service nova] Creating event network-vif-plugged:e9250e3a-abdf-4937-94be-280537dbafc1 for instance aa727284-0146-40af-8dca-26bd48b90cb8 on hv-cinder-80377 Jun 17 08:55:26.656454 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-126ea95b-7e15-4ac6-8d09-efa518c07f26 req-5adeaf87-bb72-4244-82c5-6311b0dd26ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Jun 17 08:55:26.657084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 575/1150] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:27.295443 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:27.296058 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:27.298060 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:27.298712 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:27.300032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:27.304776 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.305224 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.305973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:27.306399 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:27.310653 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:27.435659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:27.443438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-63ccbc3b-b60d-40c5-95b2-f5099bc941ac tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.152780 Jun 17 08:55:27.443995 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 576/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:27 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:28.456808 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:28.461438 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:28.462137 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:28.468279 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:28.468775 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:28.472536 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:28.472536 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:28.607294 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:28.614790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-1863572a-1f84-44a5-8912-0e9db0dc383a tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1314 microversion: 2.1 time: 0.158944 Jun 17 08:55:28.615352 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 576/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:28 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:29.632363 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:29.633010 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:29.641479 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.641939 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.642699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:29.643137 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:29.771297 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:29.778723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-83c94614-503f-4cd9-9889-3f8a7f1cb039 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1499 microversion: 2.1 time: 0.150244 Jun 17 08:55:29.779293 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 577/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:29 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:30.630864 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:30.631431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:30.638563 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:30.639351 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:30.640144 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:30.640607 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:30.667561 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Going to try to terminate instance {{(pid=124546) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:55:31.080575 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0afca4e7-09b7-401f-903d-4dce92679ec7 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 204 len: 0 microversion: 2.1 time: 0.453299 Jun 17 08:55:31.081166 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 577/1154] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:55:30 2022] DELETE /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:55:31.089572 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:31.090229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:31.096871 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:31.097321 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:31.098080 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:31.098515 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:31.233153 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:31.240607 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dd36aa43-f57b-4eb1-b4d1-140f98cccbe0 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1505 microversion: 2.1 time: 0.155080 Jun 17 08:55:31.241168 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 578/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:31 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:32.259761 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:32.260366 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:32.268141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:32.268635 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:32.269412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:32.269855 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:32.401941 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:32.410745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-9425e8ad-1f5d-403b-a58d-cb0dddb9159f tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1505 microversion: 2.1 time: 0.155269 Jun 17 08:55:32.411302 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 578/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:32 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:33.256193 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-d60db777-59de-4892-a228-ba710d5087da req-a67065ed-73fc-439a-8aa8-13d78f236850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa727284-0146-40af-8dca-26bd48b90cb8", "name": "network-vif-deleted", "tag": "e9250e3a-abdf-4937-94be-280537dbafc1"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:55:33.264892 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-d60db777-59de-4892-a228-ba710d5087da req-a67065ed-73fc-439a-8aa8-13d78f236850 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:33.265332 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-d60db777-59de-4892-a228-ba710d5087da req-a67065ed-73fc-439a-8aa8-13d78f236850 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:33.276032 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-d60db777-59de-4892-a228-ba710d5087da req-a67065ed-73fc-439a-8aa8-13d78f236850 service nova] Creating event network-vif-deleted:e9250e3a-abdf-4937-94be-280537dbafc1 for instance aa727284-0146-40af-8dca-26bd48b90cb8 on hv-cinder-80377 Jun 17 08:55:33.281649 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-d60db777-59de-4892-a228-ba710d5087da req-a67065ed-73fc-439a-8aa8-13d78f236850 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 Jun 17 08:55:33.282219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 579/1157] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:55:33.428106 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:33.428815 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:33.435353 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:33.435886 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:33.436790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:33.437228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:33.499453 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7251818efb8e43bc90902302f7b482f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06929b24e45545439cc33e50894ce607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:55:33.507080 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f57b5d5a-803e-4799-834e-4e9dfed6c657 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 200 len: 1299 microversion: 2.1 time: 0.083233 Jun 17 08:55:33.507647 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 579/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:33 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:55:34.524340 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:55:34.525154 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] [instance: aa727284-0146-40af-8dca-26bd48b90cb8] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:55:34.531409 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:34.531855 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:34.532673 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:55:34.533135 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:55:34.548842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] HTTP exception thrown: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Request method failure captured: Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 HTTP/1.1 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirEFaCSq7a3GrqolgaVqMqpUk-n16M78q4SxBVUuyKuDKiNqDJv7hiZjdaWyjUBsHUsKWi7ZZKHGGFx2KYkSREbs4bTNWyLzjKEAt-mRPUD-YXxfuyp9KKlPzz6krBHveuDnJCTQwdcO9OLmMKA62bClC_MbhNSUMxFBaPA8xoybwBvs Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: 06929b24e45545439cc33e50894ce607 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-VolumesActionsTest-523296744 Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:55:34.550722 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06929b24e45545439cc33e50894ce607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06929b24e45545439cc33e50894ce607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06929b24e45545439cc33e50894ce607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06929b24e45545439cc33e50894ce607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-VolumesActionsTest-523296744 Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: 06929b24e45545439cc33e50894ce607 Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-VolumesActionsTest-523296744 Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-VolumesActionsTest-523296744-project Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: 7251818efb8e43bc90902302f7b482f8 Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-VolumesActionsTest-523296744-project Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. Jun 17 08:55:34.552343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': 'aa727284-0146-40af-8dca-26bd48b90cb8'} Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:55:34.553278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. Jun 17 08:55:34.554988 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:55:34.556541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] Returning 404 to user: Instance aa727284-0146-40af-8dca-26bd48b90cb8 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:55:34.556541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ba40df18-5089-46e6-9445-8f347f5d1e26 tempest-VolumesActionsTest-523296744 tempest-VolumesActionsTest-523296744-project] 10.222.0.48 "GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8" status: 404 len: 111 microversion: 2.1 time: 0.032515 Jun 17 08:55:34.556541 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 580/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:55:34 2022] GET /compute/v2.1/servers/aa727284-0146-40af-8dca-26bd48b90cb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:56:25.539131 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-07837b59-b70a-4269-8374-4d2b6a0b4181 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'create', calling method: .version_select at 0x7ff025222160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1038868648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvAVBQp6e6wQA/jvmlU4GJvan03FHspnTMDmeYKePbNZyDXUE/0WKwkLacK02KB4Eb6n78p5B8cgvl7W0EzlvjWiG/L808UeRQgy8kX9d3DY1VnuSTdDCVPzrRlSzu8ng=="}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:25.543383 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.544076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.555051 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-07837b59-b70a-4269-8374-4d2b6a0b4181 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Getting quotas for project b8e2c2ea2a34427d80be32c8a5993538. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:25.558880 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.quota [None req-07837b59-b70a-4269-8374-4d2b6a0b4181 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Getting quotas for user f13196331fb4456abf66f19e65cd234e and project b8e2c2ea2a34427d80be32c8a5993538. Resources: {'key_pairs'} {{(pid=124546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:25.672907 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-07837b59-b70a-4269-8374-4d2b6a0b4181 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.137831 Jun 17 08:56:25.673347 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 580/1160] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 08:56:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:56:25.727950 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1028415069", "imageRef": "7488e506-c52d-4f4d-a449-d9a234b47a81", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1038868648", "networks": [{"uuid": "4c9f95dc-3501-4cb8-bd70-0cd4a697131e"}]}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:25.735013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=9 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.735841 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=21 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:25.885452 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.network.neutron [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] validate_networks() for [('4c9f95dc-3501-4cb8-bd70-0cd4a697131e', None, None, None, None, None)] {{(pid=124545) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 08:56:26.266312 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Flavor limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 08:56:26.266741 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Image limits 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 08:56:26.267213 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Flavor pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 08:56:26.267642 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Image pref 0:0:0 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 08:56:26.268167 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.virt.hardware [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 08:56:26.277126 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:26.277574 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:26.278373 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:26.278810 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:26.296576 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Getting quotas for project b8e2c2ea2a34427d80be32c8a5993538. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 08:56:26.301035 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.quota [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Getting quotas for user f13196331fb4456abf66f19e65cd234e and project b8e2c2ea2a34427d80be32c8a5993538. Resources: {'cores', 'ram', 'instances'} {{(pid=124545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 08:56:26.312072 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Going to run 1 instances... {{(pid=124545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 08:56:26.314270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7488e506-c52d-4f4d-a449-d9a234b47a81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 08:56:26.416663 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-44ee7b19-c006-479e-9ab1-79f1dc66d0f2 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692595 Jun 17 08:56:26.418015 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 581/1161] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 08:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 08:56:26.428661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-21fb4873-ea44-429f-b7a4-d5859f41a202 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:26.429681 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-21fb4873-ea44-429f-b7a4-d5859f41a202 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:26.596653 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-21fb4873-ea44-429f-b7a4-d5859f41a202 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:26.597854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-21fb4873-ea44-429f-b7a4-d5859f41a202 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1259 microversion: 2.1 time: 0.174322 Jun 17 08:56:26.598414 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 581/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:26 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:27.615733 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-e6887b0a-8204-4bc1-8c6c-adaeaf716a1e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:27.616278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-e6887b0a-8204-4bc1-8c6c-adaeaf716a1e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:27.669737 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-e6887b0a-8204-4bc1-8c6c-adaeaf716a1e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:27.677509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-e6887b0a-8204-4bc1-8c6c-adaeaf716a1e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1259 microversion: 2.1 time: 0.066296 Jun 17 08:56:27.678082 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 582/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:27 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:28.695435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:28.696151 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:28.703446 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.703896 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.704726 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:28.705193 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:28.769984 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:28.777327 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-acf9e67a-8331-4064-8b76-884183176ffd tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1311 microversion: 2.1 time: 0.086442 Jun 17 08:56:28.777885 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 582/1164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:28 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:29.800788 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:29.803365 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:29.812718 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.819767 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:29.821109 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:29.821815 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:30.009012 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:30.019960 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-c7614819-b60a-45ee-9486-15ad098aea9c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.228268 Jun 17 08:56:30.021210 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 583/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:29 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:31.038169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:31.038723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:31.045345 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.045812 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.046584 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:31.047025 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:31.187397 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:31.196934 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c3fa67d8-f6e6-458f-9d6b-b3f95e5d39c6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.163468 Jun 17 08:56:31.206900 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 583/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:31 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:32.214861 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:32.215668 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:32.222765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:32.223230 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:32.224140 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:32.224599 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:32.368250 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:32.375993 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f73b91d5-c5b8-4131-b6ca-03ddcc169986 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.165145 Jun 17 08:56:32.387548 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 584/1167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:32 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:32.530056 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:56:32.530286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 08:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:56:33.393678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:33.394685 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:33.401508 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.402041 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.402930 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:33.403437 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:33.544604 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:33.558050 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-c03d710d-f9c9-407b-8f6d-85344c3a4771 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.168231 Jun 17 08:56:33.558654 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 584/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:33 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:34.577853 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:34.579013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:34.587472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.587921 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.588742 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:34.589177 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:34.729930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:34.737520 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6559afc5-7a42-4b53-9e8a-9857893e2a9b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.165135 Jun 17 08:56:34.738350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 585/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:34 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:35.756217 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:35.757046 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:35.764111 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.764679 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.765552 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:35.765970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:35.928213 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:35.936236 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-852452cd-7bf8-4465-9ba2-b3b8023d8089 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.184898 Jun 17 08:56:35.936848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 585/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:35 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:36.953624 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:36.954240 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:36.958750 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=2 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:36.962270 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.962714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:36.963480 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:36.963909 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:37.105990 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:37.113372 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f58c61e6-dbfc-4b32-9c01-4557ae201076 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.163595 Jun 17 08:56:37.113921 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 586/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:36 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:38.130723 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:38.131344 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:38.133224 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=6 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:38.138504 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.143588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.143588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:38.143588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:38.272099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:38.279408 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fe4d5e3b-fb5d-484c-9818-a84b0ce035d8 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.152743 Jun 17 08:56:38.279970 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 586/1172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:38 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:39.297239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:39.297850 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:39.300339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell0:SELECT=8 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:39.305851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.307208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.307208 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:39.307491 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:39.438285 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:39.445899 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0c0378df-724c-4ceb-a36e-4e55f65736e7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.152596 Jun 17 08:56:39.446985 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 587/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:39 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:40.463028 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:40.463671 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:40.470240 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.470698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.472171 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:40.472641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:40.600156 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:40.607485 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a03da1a1-6cee-44e5-a5c9-76a6dbdb559c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.148415 Jun 17 08:56:40.608042 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 587/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:40 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:41.626350 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:41.627110 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:41.634356 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.634796 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.635584 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:41.636013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:41.794782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:41.802278 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4e3bbe68-5333-42d1-b35f-b5d3213358f5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.180522 Jun 17 08:56:41.804523 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 588/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:41 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:42.004535 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-dfd8250c-63e8-4b45-a7df-0c7d31bbeab7 req-390eb1d7-d564-4bdd-8537-b8ba5e93be39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:42.014898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-dfd8250c-63e8-4b45-a7df-0c7d31bbeab7 req-390eb1d7-d564-4bdd-8537-b8ba5e93be39 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:42.016940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-dfd8250c-63e8-4b45-a7df-0c7d31bbeab7 req-390eb1d7-d564-4bdd-8537-b8ba5e93be39 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:42.037969 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-dfd8250c-63e8-4b45-a7df-0c7d31bbeab7 req-390eb1d7-d564-4bdd-8537-b8ba5e93be39 service nova] Creating event network-changed:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:56:42.043108 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-dfd8250c-63e8-4b45-a7df-0c7d31bbeab7 req-390eb1d7-d564-4bdd-8537-b8ba5e93be39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042993 Jun 17 08:56:42.045415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 588/1176] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:42.819133 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:42.819737 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:42.826241 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:42.826689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:42.827480 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:42.827911 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:42.959531 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:42.966984 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dba49aac-6bf2-480f-8e96-c2f62b5a4168 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.151725 Jun 17 08:56:42.967550 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 589/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:42 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:43.985425 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:43.986141 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:43.993155 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:43.993618 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:43.994387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:43.994830 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:44.123560 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:44.131032 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cbd5a15b-2635-4c9a-ac0c-cae01657a605 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.150839 Jun 17 08:56:44.131617 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 589/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:43 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:45.147538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:45.148139 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:45.154736 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:45.155187 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:45.155947 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:45.156380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:45.288657 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:45.295972 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-827943ec-dbd2-4d10-9bec-7ebfc29427cb tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.152382 Jun 17 08:56:45.296552 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 590/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:45 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:46.313718 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:46.314293 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:46.321547 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:46.322011 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:46.322745 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:46.323180 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:46.449138 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:46.456698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-38e841cb-51ad-49e5-a1c3-c8c9d76ee3d5 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.146837 Jun 17 08:56:46.457270 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 590/1180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:46 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:47.142848 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-493cc30e-5016-4343-9f5b-9e01760e642b req-46d1d7f5-239b-4e4e-a4a4-c820ff1e375c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "name": "network-vif-plugged", "status": "completed", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:47.146616 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-493cc30e-5016-4343-9f5b-9e01760e642b req-46d1d7f5-239b-4e4e-a4a4-c820ff1e375c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:47.147054 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-493cc30e-5016-4343-9f5b-9e01760e642b req-46d1d7f5-239b-4e4e-a4a4-c820ff1e375c service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:47.158098 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-493cc30e-5016-4343-9f5b-9e01760e642b req-46d1d7f5-239b-4e4e-a4a4-c820ff1e375c service nova] Creating event network-vif-plugged:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:56:47.164296 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-493cc30e-5016-4343-9f5b-9e01760e642b req-46d1d7f5-239b-4e4e-a4a4-c820ff1e375c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Jun 17 08:56:47.164929 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 591/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:47.474228 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:47.474854 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:47.481398 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:47.481860 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:47.482674 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:47.483116 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:47.617744 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:47.625150 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-cf0f976f-01d0-4f8d-aebf-8e9cdceb50ee tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.155579 Jun 17 08:56:47.625715 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 591/1182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:47 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:48.643646 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:48.644494 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:48.650633 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:48.651079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:48.651824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:48.652252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:48.782191 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:48.789675 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-5112d8b8-eec9-48de-bb21-1928f6c9dd12 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1359 microversion: 2.1 time: 0.150982 Jun 17 08:56:48.790231 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 592/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:48 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:49.807101 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:49.807702 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:49.814218 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.814691 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:49.815903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.816339 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:49.948412 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:49.956986 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-47652279-1262-4bbc-8130-0d3d90ff48b1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1549 microversion: 2.1 time: 0.153055 Jun 17 08:56:49.957567 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 592/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:49 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:49.974310 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:49.975967 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:49.982201 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.982651 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:49.983431 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:49.983865 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.116392 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.123856 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-be77e284-42a7-4958-8bf4-13fcada566f3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1549 microversion: 2.1 time: 0.154665 Jun 17 08:56:50.124418 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 593/1185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:49 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:56:50.139168 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:50.142542 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.143851 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Searching by: {'deleted': False, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538'} {{(pid=124546) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 08:56:50.150387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.150834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.151629 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.152067 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.239609 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.multi_cell_list [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 08:56:50.334877 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f3956b12-2b83-4942-bb87-6266d2f30e88 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199324 Jun 17 08:56:50.335458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 593/1186] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jun 17 08:56:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:56:50.345620 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:56:50.346229 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:50.353264 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.353708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.354459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:50.354886 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:50.481085 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:56:50.488638 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-3f40c769-6c61-4bc6-ace6-11f3638978b3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1549 microversion: 2.1 time: 0.146839 Jun 17 08:56:50.489198 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:56:50 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:56:52.411847 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a13e203b-6d35-4d0b-8190-707c02dee86a"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:56:52.412950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:56:52.419647 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:52.420096 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:52.420890 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:56:52.421323 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:56:53.225511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-417d4c8a-5181-4462-a427-510574336462 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818454 Jun 17 08:56:53.226105 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 594/1188] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 08:56:52 2022] POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:01.809368 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:01.810063 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:01.814903 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:01.816020 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=70 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:01.819671 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:01.820121 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:01.820921 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:01.821439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:01.961366 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:01.969753 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-bc1fca25-9cab-48a5-9d3c-74d907bd1b2d tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1595 microversion: 2.1 time: 0.164775 Jun 17 08:57:01.970325 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 595/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:01 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:57:03.842177 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell0:SELECT=2 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:03.843229 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:03.843932 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:03.913376 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [req-350964d3-b483-4778-b72e-8c5636f1c65b req-28bf13b6-fd14-4c5f-8c62-cca268ba362b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:03.923076 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-350964d3-b483-4778-b72e-8c5636f1c65b req-28bf13b6-fd14-4c5f-8c62-cca268ba362b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:03.923603 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [req-350964d3-b483-4778-b72e-8c5636f1c65b req-28bf13b6-fd14-4c5f-8c62-cca268ba362b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:03.934312 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.compute.server_external_events [req-350964d3-b483-4778-b72e-8c5636f1c65b req-28bf13b6-fd14-4c5f-8c62-cca268ba362b service nova] Creating event network-changed:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:57:03.939326 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [req-350964d3-b483-4778-b72e-8c5636f1c65b req-28bf13b6-fd14-4c5f-8c62-cca268ba362b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098499 Jun 17 08:57:03.939994 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 595/1190] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:06.540973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2037843902"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:06.549748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:06.549748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:06.549748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:06.549748 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:06.550763 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:06.678380 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.network.security_group_api [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Adding security group 44d2d1f7-28fe-4730-8c72-b4f04480597d to port 80a54b67-ae18-44ba-8daa-333cc2909a2b Jun 17 08:57:07.171803 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a892fa38-5816-4d93-b39b-d6b7ac5bd4b7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action" status: 202 len: 0 microversion: 2.1 time: 0.634625 Jun 17 08:57:07.173116 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 596/1191] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:57:06 2022] POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:57:07.193198 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:57:07.194534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:57:07.195561 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-ff4c1343-3486-4d0b-8b97-68b5f1b8e949 req-8dee4df7-3a07-4328-bfae-82af77d4805b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:57:07.213184 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:07.220153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:07.220153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:07.220153 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:07.222004 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ff4c1343-3486-4d0b-8b97-68b5f1b8e949 req-8dee4df7-3a07-4328-bfae-82af77d4805b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:57:07.225239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-ff4c1343-3486-4d0b-8b97-68b5f1b8e949 req-8dee4df7-3a07-4328-bfae-82af77d4805b service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:57:07.254782 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-ff4c1343-3486-4d0b-8b97-68b5f1b8e949 req-8dee4df7-3a07-4328-bfae-82af77d4805b service nova] Creating event network-changed:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:57:07.260538 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-ff4c1343-3486-4d0b-8b97-68b5f1b8e949 req-8dee4df7-3a07-4328-bfae-82af77d4805b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073733 Jun 17 08:57:07.262079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 597/1192] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:57:07.694760 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:57:07.706065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7154b431-da7b-468d-8fac-a0e45bf32093 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1761 microversion: 2.1 time: 0.527134 Jun 17 08:57:07.708293 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 596/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:57:07 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1761 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:08.221936 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=6 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:08.222617 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=12 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:08.226875 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:58:08.227973 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:08.234013 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.234459 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.235215 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.235648 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.394212 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-dacd31cd-669c-402f-95fc-55c316e4bf4c tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action" status: 202 len: 0 microversion: 2.1 time: 0.174146 Jun 17 08:58:08.395029 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 598/1194] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:58:08 2022] POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:58:08.401879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=4 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:08.402979 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=8 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:08.406903 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:08.407520 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:08.416103 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.416593 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.417365 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:08.417809 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:08.567435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:08.576303 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-f01b4539-40be-4426-aeb3-0135e5c1e7f6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1753 microversion: 2.1 time: 0.176566 Jun 17 08:58:08.577055 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 597/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:08 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:09.595708 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:09.596401 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:09.602808 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.603255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.604007 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:09.604438 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:09.749354 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:09.757908 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-ec1f2a50-e9a0-4755-bfbb-1c9c00c8e1cc tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.167003 Jun 17 08:58:09.758472 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 599/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:09 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:10.775729 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:10.776382 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:10.783135 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.783805 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.784692 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:10.785134 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:10.927924 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:10.936084 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-eeee9e56-770f-4127-87e3-b33e1ed9dea6 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.164030 Jun 17 08:58:10.936676 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 598/1197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:10 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:11.954086 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:11.954699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:11.961607 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.962057 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:11.962824 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:11.963262 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:12.107609 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:12.116245 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4ecf3fe6-ce64-43af-b3c5-f674283695d3 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.166129 Jun 17 08:58:12.116839 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 600/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:11 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:13.133785 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:13.134403 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:13.140853 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.141314 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.142069 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:13.142503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:13.281487 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:13.289447 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d73164db-b0ff-4b95-b989-6c94683c6054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.160063 Jun 17 08:58:13.290012 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 599/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:13 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:14.307749 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:14.308659 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:14.318239 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:14.318746 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:14.319629 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:14.320125 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:14.477933 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:14.485958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-aa5291ce-e1d5-4700-97df-d36150c6bde7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.182688 Jun 17 08:58:14.486524 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 601/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:14 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 08:58:15.505474 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:15.506065 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:15.512403 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.512893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.513659 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:15.514099 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:15.652908 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:15.660684 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-7aa93ff6-5564-4088-aef4-f21b8a4deb00 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.159681 Jun 17 08:58:15.661278 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 600/1201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:15 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:16.678701 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:16.679328 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:16.685509 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.686221 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.686983 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:16.687423 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:16.837384 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:16.840249 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-d296aa2d-f737-405f-8660-7e2bae764521 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.166076 Jun 17 08:58:16.840842 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 602/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:16 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:17.857956 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:17.858557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:17.865588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.866038 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:17.866790 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:17.867222 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:18.006634 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:18.014419 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-d49272af-30bf-42bf-b152-af36d12791f1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.160302 Jun 17 08:58:18.014978 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 601/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:17 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:19.031079 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:19.031691 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:19.038375 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.038823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.039579 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:19.040014 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:19.186765 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:19.195219 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f9bb3e46-d164-4470-8dfb-469fbf788194 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.168045 Jun 17 08:58:19.195783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 603/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:19 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:20.213147 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:20.213756 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:20.219991 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.220435 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.221252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:20.221686 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:20.366576 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:20.374471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-32ba0f88-b1c0-4602-9dfc-d7a088acd1c1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.166020 Jun 17 08:58:20.375252 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 602/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:20 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:21.391424 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:21.392036 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:21.398513 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.398957 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.399709 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:21.400145 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:21.552950 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:21.561039 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a3abe33f-5597-42c2-91bb-4f683c902fec tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.173532 Jun 17 08:58:21.561870 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 604/1206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:21 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:22.578666 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:22.579357 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:22.586212 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.586658 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.587415 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:22.587848 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:22.731834 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:22.740263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5117541a-eb44-4f15-9a73-e520feb9f792 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.164944 Jun 17 08:58:22.740861 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 603/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:22 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:23.757508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:23.758124 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:23.764991 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.765439 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.766201 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:23.766631 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:23.908632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:23.917226 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-37b95b1c-a6bd-4840-90bd-d0d5ccadd4ae tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.163754 Jun 17 08:58:23.917795 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 605/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:23 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:24.934431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:24.941331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:24.941777 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:24.942263 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:24.943223 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:24.943661 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:25.090431 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:25.098641 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-5ac77ba1-ee17-4ed8-a48b-f289e4849299 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1758 microversion: 2.1 time: 0.168024 Jun 17 08:58:25.099855 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 604/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:24 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:58:26.117017 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:58:26.117639 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:58:26.124192 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.124699 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.125464 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:58:26.125903 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:58:26.267414 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:58:26.276308 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-6eaa1758-a643-41d0-815c-58861f125619 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1761 microversion: 2.1 time: 0.163725 Jun 17 08:58:26.276898 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 606/1210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:58:26 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:08.238738 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:59:08.239451 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 08:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:59:08.287626 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:59:08.288255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 08:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:59:22.210317 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2037843902"}} {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:22.210901 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:22.212800 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_api:SELECT=16 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:22.213471 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG dbcounter [-] [124546] Writing DB stats nova_cell1:SELECT=48 {{(pid=124546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:22.218246 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:22.218697 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:22.219458 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:22.219895 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:22.350454 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.network.security_group_api [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Removing security group 44d2d1f7-28fe-4730-8c72-b4f04480597d from port 80a54b67-ae18-44ba-8daa-333cc2909a2b Jun 17 08:59:22.753225 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-a9fd9915-1455-4d4f-9491-504338418054 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action" status: 202 len: 0 microversion: 2.1 time: 0.546968 Jun 17 08:59:22.754340 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 605/1211] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 08:59:22 2022] POST /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:59:22.778747 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-1ddc36d7-2547-473c-be54-ebc788d86dc8 req-6b279b7e-e6f6-44dc-b805-783d35231063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:22.785516 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_api:SELECT=18 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:22.789783 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG dbcounter [-] [124545] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:22.798554 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1ddc36d7-2547-473c-be54-ebc788d86dc8 req-6b279b7e-e6f6-44dc-b805-783d35231063 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:22.804016 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-1ddc36d7-2547-473c-be54-ebc788d86dc8 req-6b279b7e-e6f6-44dc-b805-783d35231063 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:22.829284 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-1ddc36d7-2547-473c-be54-ebc788d86dc8 req-6b279b7e-e6f6-44dc-b805-783d35231063 service nova] Creating event network-changed:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:59:22.836481 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-1ddc36d7-2547-473c-be54-ebc788d86dc8 req-6b279b7e-e6f6-44dc-b805-783d35231063 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064655 Jun 17 08:59:22.837556 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 607/1212] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:24.139210 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:24.139824 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:24.146199 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:24.146832 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:24.147621 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:24.148059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:24.245876 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lazy-loading 'services' on Instance uuid 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:59:24.545000 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR oslo.messaging._drivers.impl_rabbit [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [eee5784f-0be1-4931-934e-79769090bed8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 08:59:24.852823 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-a978759d-84f9-43bc-a014-2796eed82f99 req-462897e0-30ab-48f3-88c9-6bc1a6409655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:24.862598 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-a978759d-84f9-43bc-a014-2796eed82f99 req-462897e0-30ab-48f3-88c9-6bc1a6409655 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:24.863042 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-a978759d-84f9-43bc-a014-2796eed82f99 req-462897e0-30ab-48f3-88c9-6bc1a6409655 service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:24.875051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-a978759d-84f9-43bc-a014-2796eed82f99 req-462897e0-30ab-48f3-88c9-6bc1a6409655 service nova] Creating event network-changed:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:59:24.879958 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-a978759d-84f9-43bc-a014-2796eed82f99 req-462897e0-30ab-48f3-88c9-6bc1a6409655 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032543 Jun 17 08:59:24.880802 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 608/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:59:25.552031 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [eee5784f-0be1-4931-934e-79769090bed8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39936. Jun 17 08:59:25.555940 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-821003a9-eee3-4b59-ac63-96ac0f6ce64b tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments/a13e203b-6d35-4d0b-8190-707c02dee86a" status: 202 len: 0 microversion: 2.1 time: 1.421579 Jun 17 08:59:25.556831 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:59:24 2022] DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments/a13e203b-6d35-4d0b-8190-707c02dee86a => generated 0 bytes in 1423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:59:25.566252 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:25.567339 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:25.574521 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:25.574950 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:25.575715 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:25.576147 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:25.605152 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-0b8f2af5-9d34-43c9-8268-378193b2dbd0 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Jun 17 08:59:25.605704 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 609/1215] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:59:25 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:26.618557 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:26.620378 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:26.626730 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:26.628652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:26.628652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:26.628652 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:26.658695 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-4cf9d932-7de3-4d41-8bfb-0c32a48a92d1 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Jun 17 08:59:26.663082 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 607/1216] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:59:26 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 08:59:27.670827 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:27.671689 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:27.679286 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.680200 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.680632 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.681092 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.712694 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-a9d2bdab-d300-4ee8-ad66-e975aed5a9ba tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046216 Jun 17 08:59:27.713271 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 610/1217] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 08:59:27 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 08:59:27.723059 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:27.723620 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:27.730879 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.731323 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.732079 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:27.732534 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:27.808822 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.wsgi [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] HTTP exception thrown: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 is not attached to volume a13e203b-6d35-4d0b-8190-707c02dee86a Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Request method failure captured: Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: request: DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments/a13e203b-6d35-4d0b-8190-707c02dee86a HTTP/1.1 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept: application/json Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Accept-Encoding: identity Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Connection: close Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Length: 0 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Content-Type: application/json Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Host: 10.222.0.48 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Openstack-System-Scope: None Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Auth-Token: gAAAAABirEGo0RhagS_ZV-unPg6_LfDRzn__h0DzZl4rPrCky3fpmFjO4vxK3JTiAGBfvOa96FduHReZnHDYSDNq6nXjZr7Gpciu6XdeFKoBu_mkzzED87qf29uXkU7eQz57ixzPIdaskwjzXOgxn0hhYp2PM5CxO_DUiLQR1GCXuVoPMBPghUM Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Id: None Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Domain-Name: None Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Identity-Status: Confirmed Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Is-Admin-Project: True Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Id: default Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Domain-Name: Default Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Id: b8e2c2ea2a34427d80be32c8a5993538 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Project-Name: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Role: reader,member Jun 17 08:59:27.811511 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Roles: reader,member Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Id: b8e2c2ea2a34427d80be32c8a5993538 Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User: tempest-TestMinimumBasicScenario-1744567799-project Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Id: default Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Domain-Name: Default Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Id: f13196331fb4456abf66f19e65cd234e Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: X-User-Name: tempest-TestMinimumBasicScenario-1744567799-project Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: method: > Jun 17 08:59:27.813379 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: exception: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 is not attached to volume a13e203b-6d35-4d0b-8190-707c02dee86a Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: action_args: {'server_id': '1b128b7c-0d9e-4e8e-9cc6-85072c8ab554', 'id': 'a13e203b-6d35-4d0b-8190-707c02dee86a'} Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a13e203b-6d35-4d0b-8190-707c02dee86a. Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:27.814441 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 is not attached to volume a13e203b-6d35-4d0b-8190-707c02dee86a Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 is not attached to volume a13e203b-6d35-4d0b-8190-707c02dee86a Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: ERROR nova.api.openstack.wsgi Jun 17 08:59:27.816387 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Returning 404 to user: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 is not attached to volume a13e203b-6d35-4d0b-8190-707c02dee86a {{(pid=124546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:27.817698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0bebd9f8-40c3-442b-9290-e21424570a79 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments/a13e203b-6d35-4d0b-8190-707c02dee86a" status: 404 len: 154 microversion: 2.1 time: 0.093908 Jun 17 08:59:27.817698 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 608/1218] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 08:59:27 2022] DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554/os-volume_attachments/a13e203b-6d35-4d0b-8190-707c02dee86a => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:29.080346 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:29.080917 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:29.087422 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.087851 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.088654 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.089095 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.113930 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Going to try to terminate instance {{(pid=124545) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 08:59:29.444980 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-f6c4c233-d1be-45d6-b7ef-4269d830b709 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 204 len: 0 microversion: 2.1 time: 0.368012 Jun 17 08:59:29.445484 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 611/1219] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 08:59:29 2022] DELETE /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 08:59:29.453655 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:29.454273 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:29.464963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.464963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.464963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:29.464963 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:29.597338 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:29.605605 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-fef0a2f4-34da-4e7c-8e18-a042dc0865f7 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1555 microversion: 2.1 time: 0.155852 Jun 17 08:59:29.606169 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 609/1220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:29 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:30.623170 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:30.623873 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:30.630398 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:30.631130 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:30.631907 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:30.632346 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:30.765282 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.policy [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124545) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:30.772923 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-79656ec0-c4ea-4334-ae1b-df001c77ea6e tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1555 microversion: 2.1 time: 0.154042 Jun 17 08:59:30.773485 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 612/1221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:30 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:31.790331 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:31.790893 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:31.797523 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:31.803022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:31.803022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:31.803022 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:31.862354 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:31.870996 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-87b0d5ef-e17c-428b-9ebb-f66096f6d0d9 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1513 microversion: 2.1 time: 0.084700 Jun 17 08:59:31.871578 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 610/1222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:31 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:32.006454 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [req-9ccfcc69-032d-42af-b5bf-e1ea84f43825 req-68a9c3fa-b09c-417d-835c-d95f0350d5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b128b7c-0d9e-4e8e-9cc6-85072c8ab554", "name": "network-vif-deleted", "tag": "80a54b67-ae18-44ba-8daa-333cc2909a2b"}]} {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 08:59:32.014714 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-9ccfcc69-032d-42af-b5bf-e1ea84f43825 req-68a9c3fa-b09c-417d-835c-d95f0350d5aa service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.015162 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [req-9ccfcc69-032d-42af-b5bf-e1ea84f43825 req-68a9c3fa-b09c-417d-835c-d95f0350d5aa service nova] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.026255 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.compute.server_external_events [req-9ccfcc69-032d-42af-b5bf-e1ea84f43825 req-68a9c3fa-b09c-417d-835c-d95f0350d5aa service nova] Creating event network-vif-deleted:80a54b67-ae18-44ba-8daa-333cc2909a2b for instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 on hv-cinder-80377 Jun 17 08:59:32.031122 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [req-9ccfcc69-032d-42af-b5bf-e1ea84f43825 req-68a9c3fa-b09c-417d-835c-d95f0350d5aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138601 Jun 17 08:59:32.031702 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 613/1223] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 08:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 08:59:32.888588 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:32.889142 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.compute.api [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124546) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:32.895972 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.897678 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.898521 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.898911 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.933056 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:32.933503 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG oslo_concurrency.lockutils [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:32.933950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.objects.instance [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lazy-loading 'fault' on Instance uuid 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 {{(pid=124546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 08:59:32.978312 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.policy [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13196331fb4456abf66f19e65cd234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e2c2ea2a34427d80be32c8a5993538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124546) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 08:59:32.985092 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-0a862d8c-9db4-4687-858d-6b9e0466957a tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 200 len: 1349 microversion: 2.1 time: 0.100580 Jun 17 08:59:32.988457 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 611/1224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:32 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 08:59:34.003736 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '>' {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:34.004359 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.compute.api [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] [instance: 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554] Fetching instance by UUID {{(pid=124545) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 08:59:34.010835 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:34.011283 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:34.012051 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 08:59:34.012566 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG oslo_concurrency.lockutils [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Lock "31d0bb3b-ac5e-4898-8788-aaf56ff0084f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 08:59:34.026508 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.wsgi [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] HTTP exception thrown: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Request method failure captured: Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: request: GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 HTTP/1.1 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept: application/json Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Accept-Encoding: identity Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Connection: close Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Length: 0 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Content-Type: application/json Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Host: 10.222.0.48 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Openstack-System-Scope: None Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: User-Agent: python-urllib3/1.26.9 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Auth-Token: gAAAAABirEGo0RhagS_ZV-unPg6_LfDRzn__h0DzZl4rPrCky3fpmFjO4vxK3JTiAGBfvOa96FduHReZnHDYSDNq6nXjZr7Gpciu6XdeFKoBu_mkzzED87qf29uXkU7eQz57ixzPIdaskwjzXOgxn0hhYp2PM5CxO_DUiLQR1GCXuVoPMBPghUM Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Id: None Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Domain-Name: None Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Identity-Status: Confirmed Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Is-Admin-Project: True Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Id: default Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Domain-Name: Default Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Id: b8e2c2ea2a34427d80be32c8a5993538 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Project-Name: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Role: reader,member Jun 17 08:59:34.028149 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Roles: reader,member Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b8e2c2ea2a34427d80be32c8a5993538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Id: b8e2c2ea2a34427d80be32c8a5993538 Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1744567799 Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User: tempest-TestMinimumBasicScenario-1744567799-project Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Id: default Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Domain-Name: Default Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Id: f13196331fb4456abf66f19e65cd234e Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: X-User-Name: tempest-TestMinimumBasicScenario-1744567799-project Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: method: > Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: exception: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. Jun 17 08:59:34.029881 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: action_args: {'id': '1b128b7c-0d9e-4e8e-9cc6-85072c8ab554'} Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: {{(pid=124545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 08:59:34.030934 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. Jun 17 08:59:34.032723 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: ERROR nova.api.openstack.wsgi Jun 17 08:59:34.034336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: DEBUG nova.api.openstack.wsgi [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Returning 404 to user: Instance 1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 could not be found. {{(pid=124545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 08:59:34.034336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO nova.api.openstack.requestlog [None req-4457d05d-5cf5-40b9-ad34-4da166843179 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554" status: 404 len: 111 microversion: 2.1 time: 0.030869 Jun 17 08:59:34.034336 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: [pid: 124545|app: 0|req: 614/1225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 08:59:33 2022] GET /compute/v2.1/servers/1b128b7c-0d9e-4e8e-9cc6-85072c8ab554 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 08:59:34.041023 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: DEBUG nova.api.openstack.wsgi [None req-6cf0be9d-3226-4d4e-a46b-0dfa06aa5c29 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] Calling method '.version_select at 0x7ff0267811f0>' {{(pid=124546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 08:59:34.155985 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO nova.api.openstack.requestlog [None req-6cf0be9d-3226-4d4e-a46b-0dfa06aa5c29 tempest-TestMinimumBasicScenario-1744567799 tempest-TestMinimumBasicScenario-1744567799-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1038868648" status: 202 len: 0 microversion: 2.1 time: 0.119035 Jun 17 08:59:34.156701 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: [pid: 124546|app: 0|req: 612/1226] 10.222.0.48 () {58 vars in 1271 bytes} [Fri Jun 17 08:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1038868648 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 08:59:52.539343 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:59:52.539854 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 08:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:00:53.140950 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:00:53.141531 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 09:00:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:02:28.247526 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:02:28.248240 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 09:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:02:28.296271 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:02:28.296792 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 09:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:02:44.783496 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:02:44.784144 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 09:02:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:03:12.547112 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:03:12.547816 dv-cinder-803773-4-iscsi devstack@n-api.service[124545]: Fri Jun 17 09:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:04:13.148773 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:04:13.149372 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 09:04:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 09:04:25.562156 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 09:04:25.562898 dv-cinder-803773-4-iscsi devstack@n-api.service[124546]: Fri Jun 17 09:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!